-- Logs begin at Thu 2022-09-01 04:36:22 UTC, end at Thu 2022-09-01 05:43:39 UTC. -- Sep 01 05:05:34.816854 dv-cinder-836027-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 05:05:34.828794 dv-cinder-836027-8-smb devstack@keystone.service[81481]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:05:34 2022] *** Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: nodename: dv-cinder-836027-8-smb Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: machine: x86_64 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: clock source: unix Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: pcre jit disabled Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: detected number of CPU cores: 4 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: current working directory: / Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: your processes number limit is 47680 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: your memory page size is 4096 bytes Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: detected max file descriptor number: 2048 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: lock engine: pthread robust mutexes Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: thunder lock: enabled Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 05:05:34.840824 dv-cinder-836027-8-smb devstack@keystone.service[81481]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:05:34.880190 dv-cinder-836027-8-smb devstack@keystone.service[81481]: Python main interpreter initialized at 0x55a67800c9c0 Sep 01 05:05:34.880190 dv-cinder-836027-8-smb devstack@keystone.service[81481]: python threads support enabled Sep 01 05:05:34.880190 dv-cinder-836027-8-smb devstack@keystone.service[81481]: your server socket listen backlog is limited to 100 connections Sep 01 05:05:34.880190 dv-cinder-836027-8-smb devstack@keystone.service[81481]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:05:34.880896 dv-cinder-836027-8-smb devstack@keystone.service[81481]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:05:34.880896 dv-cinder-836027-8-smb devstack@keystone.service[81481]: *** Operational MODE: preforking *** Sep 01 05:05:34.881295 dv-cinder-836027-8-smb devstack@keystone.service[81481]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:05:34.881295 dv-cinder-836027-8-smb devstack@keystone.service[81481]: spawned uWSGI master process (pid: 81481) Sep 01 05:05:34.881577 dv-cinder-836027-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 05:05:34.888663 dv-cinder-836027-8-smb devstack@keystone.service[81481]: spawned uWSGI worker 1 (pid: 81496, cores: 1) Sep 01 05:05:34.888663 dv-cinder-836027-8-smb devstack@keystone.service[81481]: spawned uWSGI worker 2 (pid: 81497, cores: 1) Sep 01 05:05:34.888663 dv-cinder-836027-8-smb devstack@keystone.service[81481]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:05:39.875811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:39.875811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: from cryptography.utils import int_from_bytes Sep 01 05:05:39.877375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:39.877375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: from cryptography.utils import int_from_bytes Sep 01 05:05:39.877605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:39.877605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: from cryptography.utils import int_from_bytes Sep 01 05:05:39.877605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:05:39.877605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: from cryptography.utils import int_from_bytes Sep 01 05:05:39.928335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:05:39.928605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:05:39.928977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] command line args: [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:05:39.929235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:05:39.929377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ================================================================================ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:05:39.929642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] admin_token = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.929871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] config_dir = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.930021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.930253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] config_source = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.930389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] debug = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.930503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:05:39.930618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.934531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:05:39.934531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] command line args: [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:05:39.934782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.934907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:05:39.935021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ================================================================================ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:05:39.935261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] admin_token = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config_dir = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.935921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_config_append = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.936025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] config_source = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.936120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.936222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] debug = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.936319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_dir = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.936430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.936571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.937274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.937577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.937891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.938317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.938665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.939169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.939504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.939858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.940216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.940588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.940965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_config_append = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.941300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.941631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.941967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.942321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_dir = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.942321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.942932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.943191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.943444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.943757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.944060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.944277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.944606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.944879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.945104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.945320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.945541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.945755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.945977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.946192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.946588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.946803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.946803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.946803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.947453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.947662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.947878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] publish_errors = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.948085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.948299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.948299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.948723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.948939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.949158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.949364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.949577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.949794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.949794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] standard_threads = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.950197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.950415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.950629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] publish_errors = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.950865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.951082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.951287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.951490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.951703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] use_journal = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.951909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.952186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] use_json = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.952186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] use_stderr = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.952578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.952823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] use_syslog = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.953045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.953045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] standard_threads = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.953448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.953654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.953858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.954124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.954124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.954596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.954826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_journal = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.954826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_json = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.955225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.955433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_stderr = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.955641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.955845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] use_syslog = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.956083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.956288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:05:39.956492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.956829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.957049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.957254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.957481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.957885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.958108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.958316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.958523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.958738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.958738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.959145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.959367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.959582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.959788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.959992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.960207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.960413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.960640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.960844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.961063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.961270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.961493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.961711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.961915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.962145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.962358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.962564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.962891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.963099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.963304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.963518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.963725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.963937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.964220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.964427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.964667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.964884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.965117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.965323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.965583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.965788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.965993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.966198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.966411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.966628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.966832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.967047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.967255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.967457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.967662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.967881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.968102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.968306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.968517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.968762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.968971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.969186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.969392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.969596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.969808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.970025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.970398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.970618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.970824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.971047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.971252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.971457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.971907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.972134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.972340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.972546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.972784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.972986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.973191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.973509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.973509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.973901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.974106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.974411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.974411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.974814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.975030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.975237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.975440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.975644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.975849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.976066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.976279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.976486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.976728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.976992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.977214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.977437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.977643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.977856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.977856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.978260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.978465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.978692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.978901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.979210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.979431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.979637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.979893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.980117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.982583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.982918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.983261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.983616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.983967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.984314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.984805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.985140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.985471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.986306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.986651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.987002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.987346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.987701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.987701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.988352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.988683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.988947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.989179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.989434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.989657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.989876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.990132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.990353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.990576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.990785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.991017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.991225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.991481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.991690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.991907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.992117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.992325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.992530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.992820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.993031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.993258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.993468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.993685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.993890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.994204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.994424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.994708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.994916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.995122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.995122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.995534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.995741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.995958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.996164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.996370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.996575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.996805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.997012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.997255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.997465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.997675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.997882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.998098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.998306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.998525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.998733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.998937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.999141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.999345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.999553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:39.999874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.000099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.000305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.000523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.000777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.000985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.001203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.001579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.001815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.002024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.002231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.002436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.002650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.002861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.003090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.003315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.003524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.003734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.003942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.004163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.004373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.004667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.004887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.005112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.005335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.005560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.005766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.005974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.005974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.006382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.006602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.006824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.007033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.007238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.007443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.007650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.external = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.007650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.008116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.008338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.008562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.008857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.009051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.external = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.009260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.password = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.009776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.009968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] auth.token = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.010172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.010368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.010558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.010750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.010945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.password = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.011139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.011341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] auth.token = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.011532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.011724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.011915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.012104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.012313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.012515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.012678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.012878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.013081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.013272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.013462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.013665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.013858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.014060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.014252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.014442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.014631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.014863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.014998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.015143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.015274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.015411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.015542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.015683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.015824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.016841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.017942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.018992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.019946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.020827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.021832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.022948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.023906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.024941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.025178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.025306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.025438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.025589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.025718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.025911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.026874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.027915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.028974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029088 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.029946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.030887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.031881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.032004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.032177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.032325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.036182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.036455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.036605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.036812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.036959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.037982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.038131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.038444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.038585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.038703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.038820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.038934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.039898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.040891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.041953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.042891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.043965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.044916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.045980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.046985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] role.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.047878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.048099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] role.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.048099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.048387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.048387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.048598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.048926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.049975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.050970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.051952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.052775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.053807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.054106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.054255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.054411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.054565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.054718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.054886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.055993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.056998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.059200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.060806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.062261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.063731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.065394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.066849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.066849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.067194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.068605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.070088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:05:40.071529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:05:40.072832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.072832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.072832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.077155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.097102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.097462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.097724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.107589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.117138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.117479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.128960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.129275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.181967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.183473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.271307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.271539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.271628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.271743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.346591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.346848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.346994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.347213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.347457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.347648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.376805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.377123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.377457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.377873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.378155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.378556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.378897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.439753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.440240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.440240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.440240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.440799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.440799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.455431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.455858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.456102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.456329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.456549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.456793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.456986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.466067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.481154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.481397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.481549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.481809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.481985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.482233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.482423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.501131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.501419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:05:40.501782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.501985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:05:40.502266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.502863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.503131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.503400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.513790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.514212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.514638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.515013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.515167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.519782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.520100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.520444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.520712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.520895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.521105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.521320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:05:40.523663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.526917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.527319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.527760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.528151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.528522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.528929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.529295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.529804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.530180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.530570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.530937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.535902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.536202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:05:40.536758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.537052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:05:40.537454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.537838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.538220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.538593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.551871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.552186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.552462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.552785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.554411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.555945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.556235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.560040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.561055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.561355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.561641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.563033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.563320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.563602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.563947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.564306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.564567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.564870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.565144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.565416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.565687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.566090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.568440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.568772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.572950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.573247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.573539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.573824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.574102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.574396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.574653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.574928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.589599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.591118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.591408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.592756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.593062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.596314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.596656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.597035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.597386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.600846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.601153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.603997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.604299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.605667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.608809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.609012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.609185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.609387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.609673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.609955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.610234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.610507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.611166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.612443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.612785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.613077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.613362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.613653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.613934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.627753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.628031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.630195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.630510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.630785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.631047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.632039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.635779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.636095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.638587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.640179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.640395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.641759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.642246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.643634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.644821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.645115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.645539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.645814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.646100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.646942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.647252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.647536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.647822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.648116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.648392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.657555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.657989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.658395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.658685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.659067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.659246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.659552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.665301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.665693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.666027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.666361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.675156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.675456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.676986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.678394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.678685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.679047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.681420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.682138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.682521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.682869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.683007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.683348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.683844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.684552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.684875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.685171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.692238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.693786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.696950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.697167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.697303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.697540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.697693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.697863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.698052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.698445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.698935 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.699345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.699773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.706114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.706463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.706715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.713922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.714208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.714523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.714831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.715110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.715390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.715670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.715970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.716307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.716553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.716868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.717101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.717262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.717394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.717653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.720030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.723049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.724505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.726046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.726329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.726757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.733469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.735063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.738500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.738972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.739312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.739659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.747636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.747942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.748226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.754184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a67800c9c0 pid: 81497 (default app) Sep 01 05:05:40.755878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:05:40.756182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.756501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.756892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.757174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.757459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.757841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.758122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.758406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.758677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.758832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c89b1-6420-4518-b6ee-9d31d5448a39 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:40.758974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.759221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.759753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c89b1-6420-4518-b6ee-9d31d5448a39 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:40.759884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.760134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:05:40.760285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c89b1-6420-4518-b6ee-9d31d5448a39 None None] PATH_INFO: `/v3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:40.764991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Thu Sep 1 05:05:40 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:05:40.794132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a67800c9c0 pid: 81496 (default app) Sep 01 05:05:48.343596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:48.344253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:48.344253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:48.346011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:05:48.355246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:48.355962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:48.355962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:48.430998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: INFO dbcounter [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] Registered counter for database keystone Sep 01 05:05:48.452938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG oslo_db.sqlalchemy.engines [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:48.460649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writer thread running {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:48.667700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG passlib.handlers.bcrypt [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81496) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 05:05:48.668219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG passlib.handlers.bcrypt [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81496) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 05:05:48.731160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:48.733036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:48.899541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 05:05:49.419606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:49.495430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: INFO dbcounter [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] Registered counter for database keystone Sep 01 05:05:49.520712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG oslo_db.sqlalchemy.engines [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:05:49.528041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writer thread running {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:05:49.683542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106320ee-e9d8-4412-a062-537ab4c071da None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:49.688924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:49.689727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:49.690003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:49.690269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:49.700770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:49.754169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 05:05:49.754489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555c0ed-b70e-44df-9a56-d61e0e4559a1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:49.766238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Sep 1 05:05:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:05:49.773530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:49.790361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42969ea-d58d-4453-a122-5e8132ea15e9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:49.795314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:49.796723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:49.797010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:49.797288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] PATH_INFO: `/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:49.799493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] RBAC: Authorizing `identity:get_project(project_id=c21f4c2bbfcf4e0f8ddce568cdfb4031)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:49.853741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING keystone.common.rbac_enforcer.enforcer [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 05:05:49.854093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189292-8710-450d-9d3a-b8a422cf874a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:49.858980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Thu Sep 1 05:05:49 2022] GET /identity/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:05:52.067910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454ad08-ec99-4096-8229-d16aac33e16e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:52.068516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454ad08-ec99-4096-8229-d16aac33e16e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:52.068516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454ad08-ec99-4096-8229-d16aac33e16e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:52.072662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:05:52.079123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:52.079738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:52.079900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:52.102133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:52.103758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:52.113280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 05:05:52.389413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454ad08-ec99-4096-8229-d16aac33e16e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:52.403920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454ad08-ec99-4096-8229-d16aac33e16e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:52.409681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57f60e-3a10-46d5-81b1-f424e8f0d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:52.410379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f60e-3a10-46d5-81b1-f424e8f0d56a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:52.410732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f60e-3a10-46d5-81b1-f424e8f0d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:52.411057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f60e-3a10-46d5-81b1-f424e8f0d56a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:52.420842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57f60e-3a10-46d5-81b1-f424e8f0d56a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:52.422747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57f60e-3a10-46d5-81b1-f424e8f0d56a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:52.434057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Sep 1 05:05:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:05:52.440783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:52.450967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e846b3-bb77-4b06-ab43-1836b517bdc7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:52.457471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525634e-e798-44fa-b95f-ee981cca7592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:52.458141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525634e-e798-44fa-b95f-ee981cca7592 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:52.458470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525634e-e798-44fa-b95f-ee981cca7592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:52.458827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525634e-e798-44fa-b95f-ee981cca7592 admin admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:52.460443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525634e-e798-44fa-b95f-ee981cca7592 admin admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:52.462405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525634e-e798-44fa-b95f-ee981cca7592 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:52.464069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Thu Sep 1 05:05:52 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:05:55.137086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aba68-7bd7-46fb-b238-260caa994937 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:55.137965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aba68-7bd7-46fb-b238-260caa994937 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:55.137965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aba68-7bd7-46fb-b238-260caa994937 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:55.139506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:05:55.145651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b91c2-65a4-4928-b26d-6e91dc3db1f8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:55.146438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b91c2-65a4-4928-b26d-6e91dc3db1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:55.146438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b91c2-65a4-4928-b26d-6e91dc3db1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:55.166242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2a5b91c2-65a4-4928-b26d-6e91dc3db1f8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:55.167525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2a5b91c2-65a4-4928-b26d-6e91dc3db1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:55.269026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 5/11] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:05:55.420558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa068a-8015-4337-bcf4-9950db975aa1 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:55.421014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa068a-8015-4337-bcf4-9950db975aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:55.421375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa068a-8015-4337-bcf4-9950db975aa1 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:55.422910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 7/12] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:05:55.431995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:55.432486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:55.433011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:55.466459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:55.468452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:55.492030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:55.541210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa068a-8015-4337-bcf4-9950db975aa1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:55.555004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:05:55.791602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa068a-8015-4337-bcf4-9950db975aa1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:55.855162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:55.856557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:55.857063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:55.857580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:55.866615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:55.878113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:05:55.893302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:05:55.894557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:05:55.896531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 8/14] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:05:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:05:55.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:55.957831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.047587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65750a38-b9c7-4055-bfea-734e9fb2748f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.058462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab40ffd-19da-49b7-a2a7-867676d6b312 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.099618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.100403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.100720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.100999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.113118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.113899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.114820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.115210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.116370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:05:56.116833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.118433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.127978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.133455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 9/15] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:05:56.139623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:56.194787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.196449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.260188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.270090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c67b8-bf56-4b85-930e-1a75d750746c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.324232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 7/16] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:56.330686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:56.336189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.337322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.337776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.338214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.341119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.343806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.346934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 10/17] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:05:56 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:05:56.353969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:56.406557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.469481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae16a29-fd2a-4623-9a56-c04d76dc3751 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.481858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaadb29-4a5a-4b59-a533-6f1eefe0cb10 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.513562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.514222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.514502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.514771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.519904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.520556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.520870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.521140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.522474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.523987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.525950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 11/18] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:05:56.527061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.528583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.533779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:05:56.548665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:05:56.549956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:05:56.551439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:05:56.551439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:05:56.551439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:05:56.551439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 8/19] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:05:56.557171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:56.571052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.655339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bf325-0bdc-48b7-b7ff-6e7e8a2198b9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.685613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600d7b-94fb-4024-8209-7b74e410bee7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:56.688283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.705590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.706234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.706512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.706786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.707556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.domain.id=default, user.id=230f8b0dcb17425a90aa8f093d4d7ce6) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:05:56.707863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.709424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cb0dd-c937-449f-b9d7-dd6505a2a782 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.721335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 12/20] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Sep 1 05:05:56 2022] GET /identity/v3/role_assignments?user.id=230f8b0dcb17425a90aa8f093d4d7ce6&scope.domain.id=default&role.id=73d94b00a1864422b65efc55999d79b0 => generated 233 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:05:56.744492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:56.745345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:56.745741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:56.746108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:56.746910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:05:56.747300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:56.748940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c81743-2e13-4bbb-8e5a-46a13e7c57dd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:56.771794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 9/21] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:05:59.557566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7079046-e955-4d71-a1bd-338595440454 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:59.559109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7079046-e955-4d71-a1bd-338595440454 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:59.559984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7079046-e955-4d71-a1bd-338595440454 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:59.562959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 13/22] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:05:59.569996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50510b43-6cef-4760-ad69-baa96f12da2f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:59.571592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50510b43-6cef-4760-ad69-baa96f12da2f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:59.572388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50510b43-6cef-4760-ad69-baa96f12da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:59.613408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-50510b43-6cef-4760-ad69-baa96f12da2f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:59.616064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-50510b43-6cef-4760-ad69-baa96f12da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:59.778547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8be12-07c4-463d-8250-457b187fd06d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:59.779524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8be12-07c4-463d-8250-457b187fd06d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:59.780253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8be12-07c4-463d-8250-457b187fd06d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:59.785077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 14/23] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:05:59.789055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 10/24] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:05:59.795071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:59.795663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:59.796125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:59.831472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG passlib.handlers.bcrypt [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81497) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 05:05:59.832226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG passlib.handlers.bcrypt [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81497) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 05:05:59.905072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:59.907228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:59.921825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3b4a1-b8f1-487b-ba16-4493461cdd58 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:59.922047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3b4a1-b8f1-487b-ba16-4493461cdd58 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:59.922409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3b4a1-b8f1-487b-ba16-4493461cdd58 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:59.929433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 11/25] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:05:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:05:59.943109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:59.943580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:59.944071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:00.002446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:00.004408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:00.103104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 15/26] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:00.151241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:00.200864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 12/27] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:00.223578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:00.373155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ea6d5-9493-4eed-ac71-2a6ce3a4d8ab None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:00.433424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:00.434759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:00.435375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:00.435850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:00.476019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:00.478758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:06:00.513756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:00.514725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:06:00.515560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:06:00.515560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:06:00.515560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:00.515760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 16/28] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:00.526461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:00.594022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:00.682753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:00.759054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4e29-c575-46ca-bcd9-3dea1840c6df None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:00.886391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:00.894705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:00.895473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:00.896087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:00.897542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:00.898238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:00.901112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:00.921492 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:00.923152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 13/29] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:00.928533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:00.954851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc4633-f1ad-4c44-8cbe-0c905740c73b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:00.996335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d01dfc-129f-4538-ad26-26c14ec3ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:00.997007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d01dfc-129f-4538-ad26-26c14ec3ef81 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:00.997286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d01dfc-129f-4538-ad26-26c14ec3ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:00.997560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d01dfc-129f-4538-ad26-26c14ec3ef81 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:00.998276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d01dfc-129f-4538-ad26-26c14ec3ef81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:00.999721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d01dfc-129f-4538-ad26-26c14ec3ef81 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:01.111654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:01.143496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 17/30] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 1 05:06:00 2022] POST /identity/v3/roles => generated 219 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:01.145032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268ae3-f504-40f2-a835-ba940f6e23a5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.145270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268ae3-f504-40f2-a835-ba940f6e23a5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.145552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268ae3-f504-40f2-a835-ba940f6e23a5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.147229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 18/31] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:01.147755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268ae3-f504-40f2-a835-ba940f6e23a5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:01.150483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa310b41-fcaf-4445-aaa1-c2c6169ba5f5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:01.238949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361e75e-0a7f-4aef-abb4-5455b652cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:01.239535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e75e-0a7f-4aef-abb4-5455b652cae4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.239815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e75e-0a7f-4aef-abb4-5455b652cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.240090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e75e-0a7f-4aef-abb4-5455b652cae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.270509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361e75e-0a7f-4aef-abb4-5455b652cae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c361e75e-0a7f-4aef-abb4-5455b652cae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:01.277099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:01.278111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:01.279487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 14/32] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:01.280155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.280155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.280653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.326923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:01.328197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:01.426931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268ae3-f504-40f2-a835-ba940f6e23a5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:01.428208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 15/33] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:01.428861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:01.501816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a6ddd-6033-4fad-8226-87ecf48b00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:01.502651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6ddd-6033-4fad-8226-87ecf48b00ef None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.503573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6ddd-6033-4fad-8226-87ecf48b00ef None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.503990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6ddd-6033-4fad-8226-87ecf48b00ef None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.506963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a6ddd-6033-4fad-8226-87ecf48b00ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:01.509828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a6ddd-6033-4fad-8226-87ecf48b00ef None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:01.529705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:01.583979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 19/34] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:06:01 2022] POST /identity/v3/projects => generated 301 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:01.585326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:01.590932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643f32-0a47-4843-847d-b858de282b3d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.591508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643f32-0a47-4843-847d-b858de282b3d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.593311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643f32-0a47-4843-847d-b858de282b3d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.598462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 20/35] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:01.606993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.607393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.607538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.645446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936d86-00c0-441b-97b7-ed4b584b47e2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:01.650859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:01.652599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:01.725988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:01.728204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.728911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.730473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.731308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:01.731616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:01.734353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:01.768011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 16/36] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:01.779143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:01.810350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 21/37] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:01.934117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227063-a692-4123-ac37-9b99c43746bc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:01.984182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:01.985189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:01.985753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:01.986190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:01.987697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:01.989439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:01.991448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 17/38] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:01 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:01.999876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:02.005230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:02.011860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:02.175583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c34f8-facf-43d9-aeab-51534f1b92d7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:02.178583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48255528-68ab-45a7-823f-d418ac58b4f9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:02.207862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:02.226347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18f692-a041-4d28-95fa-0f5ffd900752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:02.226982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f692-a041-4d28-95fa-0f5ffd900752 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:02.227264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f692-a041-4d28-95fa-0f5ffd900752 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:02.227471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27455b-64fc-4681-a65b-e4f60bc4b19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:02.227788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f692-a041-4d28-95fa-0f5ffd900752 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:02.228232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18f692-a041-4d28-95fa-0f5ffd900752 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:02.228379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27455b-64fc-4681-a65b-e4f60bc4b19c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:02.228662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27455b-64fc-4681-a65b-e4f60bc4b19c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:02.229003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27455b-64fc-4681-a65b-e4f60bc4b19c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:02.229702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18f692-a041-4d28-95fa-0f5ffd900752 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:02.230352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27455b-64fc-4681-a65b-e4f60bc4b19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:02.231970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27455b-64fc-4681-a65b-e4f60bc4b19c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:02.233872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 22/39] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:02.235245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f838-a1f5-442d-b642-917f8557dc05 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:02.235742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f838-a1f5-442d-b642-917f8557dc05 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:02.236143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f838-a1f5-442d-b642-917f8557dc05 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:02.237712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 23/40] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:02.241855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f838-a1f5-442d-b642-917f8557dc05 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:02.435793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f838-a1f5-442d-b642-917f8557dc05 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:02.441041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 18/41] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 1 05:06:02 2022] POST /identity/v3/roles => generated 225 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:02.443496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:02.443971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:02.444424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:02.474176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:02.476899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:02.508092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:02.510153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:02.510614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:02.511057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:02.512229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:02.514753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:02.539709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 24/42] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 1 05:06:02 2022] POST /identity/v3/roles => generated 223 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:02.541057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:02.614457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:02.618436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:02.644671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 19/43] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:02.719011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594562c-505f-4572-8d8b-d9ef4b2a7359 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:02.764345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:02.765096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:02.765517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:02.765682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] PATH_INFO: `/v3/domains/default/users/230f8b0dcb17425a90aa8f093d4d7ce6/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:02.768827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=230f8b0dcb17425a90aa8f093d4d7ce6, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:02.770344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:02.790209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 25/44] 10.222.0.57 () {58 vars in 1361 bytes} [Thu Sep 1 05:06:02 2022] PUT /identity/v3/domains/default/users/230f8b0dcb17425a90aa8f093d4d7ce6/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:03.025805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:03.212865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584e68f-5f02-4d65-9e1d-081895c53a38 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:03.282317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa194942-d93a-4f9a-bef9-0b261bc5edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:03.283441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194942-d93a-4f9a-bef9-0b261bc5edda None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:03.283944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194942-d93a-4f9a-bef9-0b261bc5edda None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:03.284417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194942-d93a-4f9a-bef9-0b261bc5edda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:03.286656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa194942-d93a-4f9a-bef9-0b261bc5edda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:03.289818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa194942-d93a-4f9a-bef9-0b261bc5edda None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:03.293046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 20/45] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:03.303703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:03.497889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e2e21-33fa-4696-b080-8c009da91878 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:03.510245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:03.539507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d92f-7d19-4058-a47e-ed923336b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:03.540060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d92f-7d19-4058-a47e-ed923336b107 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:03.540338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d92f-7d19-4058-a47e-ed923336b107 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:03.540608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d92f-7d19-4058-a47e-ed923336b107 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:03.541323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d92f-7d19-4058-a47e-ed923336b107 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:03.542821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d92f-7d19-4058-a47e-ed923336b107 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:03.575402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 26/46] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:06:03 2022] POST /identity/v3/projects => generated 312 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:04.803226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fa8cd-c406-43b3-9323-c384e83e6690 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:04.803865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fa8cd-c406-43b3-9323-c384e83e6690 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:04.804161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fa8cd-c406-43b3-9323-c384e83e6690 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:04.806738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 21/47] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:04.815399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:04.816189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:04.816459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:04.837247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:04.838490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:04.927182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 27/48] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:05.206178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fa8cd-c406-43b3-9323-c384e83e6690 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:05.286760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:05.338097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fa8cd-c406-43b3-9323-c384e83e6690 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:05.495868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb09c05-6ac2-4526-8bbf-ac80e2e8bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:05.496441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09c05-6ac2-4526-8bbf-ac80e2e8bda8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:05.496764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09c05-6ac2-4526-8bbf-ac80e2e8bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:05.497043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09c05-6ac2-4526-8bbf-ac80e2e8bda8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:05.509422 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb09c05-6ac2-4526-8bbf-ac80e2e8bda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5cb09c05-6ac2-4526-8bbf-ac80e2e8bda8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:05.515209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:05.516754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:05.517779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 22/49] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:05.523753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:05.670758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518786-fb9e-433b-88ee-744b0fd54be0 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:05.671192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518786-fb9e-433b-88ee-744b0fd54be0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:05.671630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518786-fb9e-433b-88ee-744b0fd54be0 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:05.673969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 23/50] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:05.682539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:05.682986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:05.683425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:05.686666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:05.703632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8bd76-5a90-4c73-b719-ea093d23aba0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:05.709001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:05.710392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:05.746460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:05.746982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:05.747284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:05.747545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:05.748235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:05.748542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:05.750056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:05.760516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 28/51] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:05.767460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:05.800650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 24/52] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:05.885860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a056c-22d4-4f99-b25d-2d2b52574e0e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:05.927942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:05.928792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:05.929083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:05.929359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:05.930802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:05.932321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:05.934039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 29/53] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:05 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:05.943239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:06.030704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:06.072190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:06.108059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f2dbb-2be9-4f34-b90e-f11a6c257a10 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:06.153761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:06.154433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:06.154716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:06.154991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:06.156240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:06.158703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:06.160503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 25/54] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:06.166986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:06.209755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:06.308358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f6166-ae8d-4cbb-8d97-c5c6a61f470a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:06.311838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9186-1572-489b-82e8-092b876fbcb3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:06.339554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:06.356878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:06.357517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:06.357810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:06.358095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:06.358841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.domain.id=default, user.id=230f8b0dcb17425a90aa8f093d4d7ce6) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:06.359156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:06.360769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:06.365874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d2797-4f0d-44a6-91cd-df5d7461722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:06.366957 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2797-4f0d-44a6-91cd-df5d7461722b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:06.367450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2797-4f0d-44a6-91cd-df5d7461722b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:06.367940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2797-4f0d-44a6-91cd-df5d7461722b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:06.369100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 26/55] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Sep 1 05:06:06 2022] GET /identity/v3/role_assignments?user.id=230f8b0dcb17425a90aa8f093d4d7ce6&scope.domain.id=default&role.id=73d94b00a1864422b65efc55999d79b0 => generated 530 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:06.370071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d2797-4f0d-44a6-91cd-df5d7461722b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:06.372903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d2797-4f0d-44a6-91cd-df5d7461722b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:06.376792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 30/56] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:06.383052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:06.511503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37918a-4b12-416f-bb25-54437c847749 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:06.554823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf6c9-6b84-4b08-81f0-1b74cc67a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:06.555753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf6c9-6b84-4b08-81f0-1b74cc67a27d None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:06.556208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf6c9-6b84-4b08-81f0-1b74cc67a27d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:06.556676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf6c9-6b84-4b08-81f0-1b74cc67a27d None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:06.557658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf6c9-6b84-4b08-81f0-1b74cc67a27d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:06.560013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf6c9-6b84-4b08-81f0-1b74cc67a27d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:06.593975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 27/57] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Sep 1 05:06:06 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:08.575895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df9db-93d5-4765-829c-dc9ad438db41 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:08.576500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df9db-93d5-4765-829c-dc9ad438db41 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:08.576500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df9db-93d5-4765-829c-dc9ad438db41 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:08.577839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 31/58] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:08.584116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:08.584696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:08.584696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:08.604253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:08.605551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:08.642121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:08.715754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 28/59] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:08.994232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df9db-93d5-4765-829c-dc9ad438db41 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:09.108659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:09.124276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df9db-93d5-4765-829c-dc9ad438db41 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:09.163664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0f77-f8a6-46ed-9544-a614a8666ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:09.164311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0f77-f8a6-46ed-9544-a614a8666ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:09.164741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0f77-f8a6-46ed-9544-a614a8666ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:09.164996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0f77-f8a6-46ed-9544-a614a8666ad6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:09.166196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0f77-f8a6-46ed-9544-a614a8666ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:09.167678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0f77-f8a6-46ed-9544-a614a8666ad6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:09.169416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 32/60] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:09.175762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:09.287461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89746f6-9cc0-4603-ab2d-00054612281f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:09.325208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1300c0a-eb1b-488d-b399-5d40b5294ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:09.325846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1300c0a-eb1b-488d-b399-5d40b5294ba1 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:09.326127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1300c0a-eb1b-488d-b399-5d40b5294ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:09.326405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1300c0a-eb1b-488d-b399-5d40b5294ba1 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:09.327077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1300c0a-eb1b-488d-b399-5d40b5294ba1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:09.328562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1300c0a-eb1b-488d-b399-5d40b5294ba1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:09.362624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 29/61] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:09 2022] POST /identity/v3/users => generated 275 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:12.983792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b47628-9708-4e9c-bba5-fa1c028326c7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:12.985144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b47628-9708-4e9c-bba5-fa1c028326c7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:12.985871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b47628-9708-4e9c-bba5-fa1c028326c7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:12.989119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 33/62] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:12.996052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ddd2-1582-45a6-ac16-c60ac62683c9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:12.997408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ddd2-1582-45a6-ac16-c60ac62683c9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:12.998098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ddd2-1582-45a6-ac16-c60ac62683c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:13.046764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7092ddd2-1582-45a6-ac16-c60ac62683c9 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:13.049236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7092ddd2-1582-45a6-ac16-c60ac62683c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:13.092282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:13.193611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 30/63] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:13.431849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f8f18-6f7d-449c-86bc-b448db5be018 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:13.432903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f8f18-6f7d-449c-86bc-b448db5be018 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:13.433680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f8f18-6f7d-449c-86bc-b448db5be018 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:13.436725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 34/64] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:13.444445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:13.444976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:13.445480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:13.489977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:13.492155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:13.545733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33d34-ba00-4f96-a7a4-2149bd0e9cc7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:13.546662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33d34-ba00-4f96-a7a4-2149bd0e9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:13.547406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33d34-ba00-4f96-a7a4-2149bd0e9cc7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:13.550074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 35/65] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:13.559136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:13.559990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:13.560730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:13.615313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:13.619819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:13.693067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 31/66] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:13.696347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:13.700102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 36/67] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:13.858676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:13.903767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf76e1-5f80-42ef-a8ab-b6d5b27292b3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:13.971267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:13.972601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:13.973323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:13.974016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:13.995146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:14.006147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:14.008803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:14.010910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:14.014670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 32/68] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:14.021377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.088890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.232701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:14.255961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80c901-20fb-411c-8c6a-afa1453633a8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:14.293916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d800-30bd-4cac-a61b-99c3643c9b24 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:14.303103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:14.303733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.304005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.304282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.305031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:14.305334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:14.306779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f3264-e24e-4006-a5e6-ebf3f24fc0d7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:14.317397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 37/69] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:14.319077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53d5c9-d5ba-4624-8f43-194dd85252ea None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.319366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53d5c9-d5ba-4624-8f43-194dd85252ea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.319636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53d5c9-d5ba-4624-8f43-194dd85252ea None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.321050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 38/70] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:14.321823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53d5c9-d5ba-4624-8f43-194dd85252ea None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.359052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:14.360058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.360798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.361359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.379907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:14.388767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:14.389733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:14.390523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:14.391121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 33/71] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:14.392916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.398333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:14.493783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53d5c9-d5ba-4624-8f43-194dd85252ea None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:14.534346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73bf65-dedc-41f7-b95d-898a8b61314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:14.535012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bf65-dedc-41f7-b95d-898a8b61314d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.535297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bf65-dedc-41f7-b95d-898a8b61314d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.535633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73bf65-dedc-41f7-b95d-898a8b61314d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.538443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bbac-c795-49d9-8064-33e5140c753d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:14.548051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73bf65-dedc-41f7-b95d-898a8b61314d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7c73bf65-dedc-41f7-b95d-898a8b61314d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:14.553056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:14.554039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:14.554878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:14.556669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 39/72] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:14.557408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.557737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.558128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.577773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc4a0-806d-41d1-b653-2d531eccb16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:14.578436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc4a0-806d-41d1-b653-2d531eccb16b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.578723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc4a0-806d-41d1-b653-2d531eccb16b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.579279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc4a0-806d-41d1-b653-2d531eccb16b None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.579472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:14.580925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:14.583422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:14.597966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc4a0-806d-41d1-b653-2d531eccb16b None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:14.599496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc4a0-806d-41d1-b653-2d531eccb16b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:14.601287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 34/73] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:14.602552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dbf15-5e2f-4e39-95ad-bc0bc1e56607 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.602835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dbf15-5e2f-4e39-95ad-bc0bc1e56607 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.603120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dbf15-5e2f-4e39-95ad-bc0bc1e56607 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.604427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 35/74] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:14.609857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dbf15-5e2f-4e39-95ad-bc0bc1e56607 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.681604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 40/75] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:14.691904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.715417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:14.802691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dbf15-5e2f-4e39-95ad-bc0bc1e56607 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:14.823075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c45da9-2c1a-4db3-bfd0-cfff7d3b8491 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:14.869090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:14.869868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.870233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.870451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.870736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:14.871156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:14.871458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:14.871778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.872466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.872932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:14.873107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.874265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:14.874801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:14.878003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59298-2814-4612-bbf4-8328c15795b2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:14.880395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:14.893038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 41/76] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:14.893038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:14.896963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 36/77] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:14.898974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:14.899205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:14.899466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:14.920468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:14.921861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:15.032577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 37/78] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:15.035388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.054541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65bf8-f921-4b34-9e50-98db2e7366cf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.117272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.125474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.126540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.126987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.127410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.187125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d108a8-cc33-4d26-9659-983d074bf77e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.234792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.235969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.236411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.237103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.238701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.240657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.243194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 38/79] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:15.244576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.255632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.259311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.261543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.388926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70ea88-66fc-4144-8c01-17e844c359cb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.414226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.419958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 42/80] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:15.421292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.432975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.433641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.433923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.434196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.435430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.436987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.438733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 39/81] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:15.439569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.574099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651805f-66e3-453e-b592-1d05b0eeda10 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.574417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.578723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e142-dfc0-4264-9e11-436dde77b6f5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.626556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.627827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.628301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.628801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.631933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.633206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.633671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.634337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.653455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:15.662234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:15.663800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:15.665403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 43/82] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:15.667626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.719846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.741557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.743969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.817516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4431a8a-242c-4c87-91db-4d682e193ab5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.861741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.862796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.863271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.863759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.865741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.868439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.871018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 40/83] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:15.876820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 44/84] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:15.877054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.877153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.924462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.986402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.003345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f61b2a-d010-4110-9331-a939506059c1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.027296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cb37-a042-4504-91c9-0d8b39cd9c69 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.051016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.052036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.052490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.052967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.054830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.057522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.066326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 41/85] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:16.066326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.087649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.088657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.089123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.089564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.184242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.185750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.219301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.228567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d5aa-7742-449a-851e-09659895af50 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.271534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.272449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.272870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.273215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.273995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:16.274403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.276031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.292730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 42/86] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:16.292730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.313601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.325349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 45/87] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:16.326499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.446368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631e6b-63c4-45a1-bb7a-884d8e947709 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.457586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7a0ca-2e86-4cf6-b6d9-7cf4814cf888 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.489501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.499352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.500017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.500290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.500564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.501910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.503418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.505172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 46/88] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:16.513904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.514107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.514257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.514257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.514257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.514257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.514257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.541106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 43/89] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:16 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:16.542648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.667140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267990e0-1e11-49b9-8fe8-fc3984e13a0f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.678666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.726787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916a76-2c59-4ad9-b91b-877262ca65d2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.740797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.741736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.742199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.742654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.744788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=a3ee5ad379424977ab3602ba23b1e1b6) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:16.745315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.747913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.757798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 47/90] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/role_assignments?user.id=a3ee5ad379424977ab3602ba23b1e1b6&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:16.758795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.799713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.800424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.800748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.801033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.803125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.804746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.806577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 44/91] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:16.807534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.917075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.998368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18ec5-9f3b-477d-8ca4-ec7818bcebc0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:17.013752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63553-d489-4f92-a12b-dc761db89914 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:17.074527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:17.075602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.076070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.076539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.078167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] RBAC: Adding query filter params (role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=a3ee5ad379424977ab3602ba23b1e1b6) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:17.078715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:17.082674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:17.091176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:17.092278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.094199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.095105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 45/92] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/role_assignments?user.id=a3ee5ad379424977ab3602ba23b1e1b6&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:17.095344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.096905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:17.102189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:17.105064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:17.114450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 48/93] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:17.119719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.121286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:17.339898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47078278-cb54-4e63-8dcb-d02e5dec0569 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:17.427305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:17.428277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.428758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.429210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.472672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad62c1-2b3f-4e11-86f8-603306ba369a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:17.574203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.588405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:17.590810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:17.597839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:17.598906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.599358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.599827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.601207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=230f8b0dcb17425a90aa8f093d4d7ce6) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:17.601730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:17.603532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.604600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:17.632973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 49/94] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:17 2022] GET /identity/v3/role_assignments?user.id=230f8b0dcb17425a90aa8f093d4d7ce6&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:17.828886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 46/95] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:17.833825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:18.119161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de965-ae94-4656-8d81-e6e010efbd59 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:18.217761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77715f7-cdda-4a52-bfc9-a36dede0e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:18.218872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77715f7-cdda-4a52-bfc9-a36dede0e028 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:18.219356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77715f7-cdda-4a52-bfc9-a36dede0e028 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:18.219891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77715f7-cdda-4a52-bfc9-a36dede0e028 None admin] PATH_INFO: `/v3/projects/f4f9fc41a1e04ba4be67781d005c9075` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:18.226129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77715f7-cdda-4a52-bfc9-a36dede0e028 None admin] RBAC: Authorizing `identity:get_project(project_id=f4f9fc41a1e04ba4be67781d005c9075)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:18.229042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77715f7-cdda-4a52-bfc9-a36dede0e028 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:18.232280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 50/96] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:17 2022] GET /identity/v3/projects/f4f9fc41a1e04ba4be67781d005c9075 => generated 312 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:18.242417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:18.486875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c4be-abfc-4b40-a95b-ce113b6ce8e1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:18.501248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:18.536579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:18.537267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:18.537546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:18.537810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:18.538561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=f4f9fc41a1e04ba4be67781d005c9075, user.id=a3ee5ad379424977ab3602ba23b1e1b6) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:18.538897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:18.540404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeec21-8866-44e2-8991-6167ba2dcac7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:18.547376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 47/97] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:18 2022] GET /identity/v3/role_assignments?user.id=a3ee5ad379424977ab3602ba23b1e1b6&scope.project.id=f4f9fc41a1e04ba4be67781d005c9075&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:19.679601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d7af-b17d-4913-8aa9-6ec326b900ba None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:19.680448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d7af-b17d-4913-8aa9-6ec326b900ba None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:19.680576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d7af-b17d-4913-8aa9-6ec326b900ba None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:19.683047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 51/98] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:19.689106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:19.689949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:19.689949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:19.719637 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:19.720984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:19.827490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 48/99] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:20.377436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d7af-b17d-4913-8aa9-6ec326b900ba None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:20.464767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:20.526306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d7af-b17d-4913-8aa9-6ec326b900ba None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:20.578699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:20.579491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:20.579765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:20.580031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:20.592958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:20.598644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:20.600768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:20.602382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 52/100] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:20.606481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:20.729328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:20.736417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f182a-1673-49b2-88f1-10955494eccc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:20.796591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:20.797265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:20.797642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:20.797953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:20.798656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:20.798964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:20.800415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:20.810821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 49/101] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:20.816881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:20.981724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568a26e-c747-4097-bb78-7c56c9b98995 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:21.011956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:21.030099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b746fd-e383-429c-ac5e-2f5c7ba6025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:21.030770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b746fd-e383-429c-ac5e-2f5c7ba6025c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.031036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b746fd-e383-429c-ac5e-2f5c7ba6025c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.031313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b746fd-e383-429c-ac5e-2f5c7ba6025c None admin] PATH_INFO: `/v3/users/5dbf433a5acd45728d0190e988a823e2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.059645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b746fd-e383-429c-ac5e-2f5c7ba6025c None admin] RBAC: Authorizing `identity:get_user(user_id=5dbf433a5acd45728d0190e988a823e2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:21.061194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b746fd-e383-429c-ac5e-2f5c7ba6025c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:21.062983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 53/102] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:20 2022] GET /identity/v3/users/5dbf433a5acd45728d0190e988a823e2 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:21.069492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:21.179890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e057-0b64-4a6b-a81c-854d53cb68bd None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.180228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e057-0b64-4a6b-a81c-854d53cb68bd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.180430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e057-0b64-4a6b-a81c-854d53cb68bd None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.182178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 54/103] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:21.190747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d7a3-f6d0-4903-a1c2-9ac10d36824b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.191993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d7a3-f6d0-4903-a1c2-9ac10d36824b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.192777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d7a3-f6d0-4903-a1c2-9ac10d36824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.205828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0eaf-d72c-41d8-8a72-fd79d9437ed0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:21.246477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9c97d7a3-f6d0-4903-a1c2-9ac10d36824b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:21.248885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c97d7a3-f6d0-4903-a1c2-9ac10d36824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:21.265439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:21.266136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.266441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.266720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.325758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:21.373133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:21.374998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:21.448839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 55/104] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:21.456651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508c7a-6b05-4220-87d8-a0cbb5b58281 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.460594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508c7a-6b05-4220-87d8-a0cbb5b58281 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.461175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508c7a-6b05-4220-87d8-a0cbb5b58281 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.462836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 56/105] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:21.469617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f36e29-40af-4fb0-bac7-8dae98a4b994 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.470240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f36e29-40af-4fb0-bac7-8dae98a4b994 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.470875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f36e29-40af-4fb0-bac7-8dae98a4b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.491844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-45f36e29-40af-4fb0-bac7-8dae98a4b994 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:21.493477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-45f36e29-40af-4fb0-bac7-8dae98a4b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:21.610636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 50/106] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:21.617334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:21.649012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 57/107] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:21.794897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:21.817522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b95c0-e9d6-4ecc-a677-7d296c9c2dfd None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.818526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b95c0-e9d6-4ecc-a677-7d296c9c2dfd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.818998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b95c0-e9d6-4ecc-a677-7d296c9c2dfd None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.824770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 58/108] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:21.827075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.827662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.828155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.861982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:21.863582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:21.908653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2aa74-38d6-49fa-a2f7-f7cb466234a2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:21.915569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:21.981550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:21.982250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:21.982540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:21.982821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:21.989592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:21.991125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:21.993086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 51/109] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:21 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:21.993440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 59/110] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:22.000389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:22.165635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5f0b4-de1e-4004-a386-67a010d3b39f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:22.208350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:22.216249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:22.220493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.221120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.221638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.222614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] RBAC: Adding query filter params (role.id=d02cc34f367b408fa485c7db59f0763b, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=5dbf433a5acd45728d0190e988a823e2) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:22.223145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:22.224971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:22.232009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 52/111] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:21 2022] GET /identity/v3/role_assignments?user.id=5dbf433a5acd45728d0190e988a823e2&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=d02cc34f367b408fa485c7db59f0763b => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:22.241369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:22.369535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:22.419112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc40d34-cec2-44fa-b81c-b08a79dfa7d2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:22.491025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc81581-8b08-4e05-a975-b03e3402e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:22.492015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81581-8b08-4e05-a975-b03e3402e040 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.492298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81581-8b08-4e05-a975-b03e3402e040 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.492591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc81581-8b08-4e05-a975-b03e3402e040 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.494866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc81581-8b08-4e05-a975-b03e3402e040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:22.496753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc81581-8b08-4e05-a975-b03e3402e040 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:22.502317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 60/112] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:22.502317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75520a-2add-4026-b062-f518edfa00e4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.502317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75520a-2add-4026-b062-f518edfa00e4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.502317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75520a-2add-4026-b062-f518edfa00e4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.502717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 61/113] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:22.503603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3261a-10cf-41ae-b083-c1cacd03197d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.503883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3261a-10cf-41ae-b083-c1cacd03197d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.504163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3261a-10cf-41ae-b083-c1cacd03197d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.506574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 62/114] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:22.512719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ead4-ca24-45c9-a0de-3ef78f78e84b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.513037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ead4-ca24-45c9-a0de-3ef78f78e84b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.513303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ead4-ca24-45c9-a0de-3ef78f78e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.540504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-16c8ead4-ca24-45c9-a0de-3ef78f78e84b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:22.541832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-16c8ead4-ca24-45c9-a0de-3ef78f78e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:22.552400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26f9b-e086-48b9-b1a9-65f4ffc52f97 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:22.577086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:22.593086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:22.594174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.594800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.595936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.612972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:22.621838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:22.622796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:22.623616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:22.632052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 53/115] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:06:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:22.632052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:22.646192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 63/116] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:22.647386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.647673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.647943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.672848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:22.674148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:22.717254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:22.763526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 64/117] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:22.764418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:22.784467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef82e-495c-4b33-ac91-301d387af352 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:22.830746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:22.832926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:22.833433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:22.833931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:22.834825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:22.836610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:22.888821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 54/118] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:06:22 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:22.890280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.028691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:23.050485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ec32-b42c-4909-9f09-982d77ec0831 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.121564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.122593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.123225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.125112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.126258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:23.128961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:23.130807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:23.161658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 65/119] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:06:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:23.163064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.183353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941e028-aa9d-4e4a-8300-5fde14920d60 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.202506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:23.263714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.264064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.264375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.265541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.279839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:23.286169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:23.287258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:23.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 55/120] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:23.289076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.333742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424010-9ed2-4b84-949b-bfa633a3c069 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.381173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.382616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.383222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.383826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.403318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:23.412954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:23.413954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:23.414731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 66/121] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:23.416948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.452964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e79a48-5d86-4cfc-8a46-7fa95a3a5a64 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.462703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:23.500429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.501591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.502019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.502639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.504527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:23.506588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:23.508814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 56/122] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:23.510688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.559309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:23.620312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64344e-f675-4afa-8551-6c5262c659b1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.648494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10bc7-ffbd-41ec-b967-892da83f5795 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.684894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.685959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.686435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.686920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.697245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.698042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.698465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.698834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.699644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:23.700043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:23.701869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:23.707840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:23.712664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 57/123] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:23.713585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:23.719161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:23.721187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:23.722956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:23.727024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 67/124] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:23.729805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.845475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:23.850111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8599-72b8-42e6-9870-0c9034990f5f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.881060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:23.904696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.905355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.905696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.906009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.906975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:23.907540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:23.909746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:23.916731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fad6-9e76-4b49-b756-dc312884990a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:23.924683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 58/125] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:23.924683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:23.986956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:23.988141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:23.988743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:23.989314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:23.991480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:23.994357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:23.998063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 68/126] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:23.999677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.072998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a365f7-165c-4f6f-b06c-c832c9bd63a1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.129699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.131152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.131729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.132200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.133802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.136045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.138145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 59/127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:24.139217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.172363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:24.191817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059ca5-b78c-4d9d-9ed5-0a3b4cdc5c9f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.260343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.261567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.262029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.262516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.263859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:24.264393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.264930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2bc47-4edb-4c73-9e11-1056ea546006 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.267609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.285327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 69/128] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:24.286699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.308926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.309162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:24.310178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.310713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.311214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.313174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.315421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.317538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 60/129] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:24 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:24.318781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.432989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:24.442451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c429ad-208a-4fa5-8553-04d114f2dbfd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.483516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.484637 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.485229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.485702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.487237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.488992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.490938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 61/130] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:24 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:24.491685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f295fe4-bdeb-47b8-ab15-7bf13db29977 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.492187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.564576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.565770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.566267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.566761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/a3ee5ad379424977ab3602ba23b1e1b6/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.571069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] RBAC: Authorizing `identity:create_grant(project_id=892640f70c834da6a9715633f0fbc7ae, user_id=a3ee5ad379424977ab3602ba23b1e1b6, role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.574077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.603050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 70/131] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:24 2022] PUT /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/a3ee5ad379424977ab3602ba23b1e1b6/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:24.604540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.623354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa7c01-7bda-4e8f-99f9-41e61195269a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.676920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.678029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.678542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.679010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.680650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.683388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.686300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 62/132] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:24 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:24.687583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.732642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:24.734122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:24.805604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f928d3e-9b98-4f64-89b3-51d670aba348 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.832377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c182991-9e98-44d1-bb31-713d4bbdc0c0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:24.873843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.875420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.876201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.876917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] PATH_INFO: `/v3/projects/f4f9fc41a1e04ba4be67781d005c9075` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.879787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f4f9fc41a1e04ba4be67781d005c9075)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.880416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:24.881307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:24.881693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:24.882029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/a3ee5ad379424977ab3602ba23b1e1b6/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:24.884113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] RBAC: Authorizing `identity:create_grant(project_id=892640f70c834da6a9715633f0fbc7ae, user_id=a3ee5ad379424977ab3602ba23b1e1b6, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:24.885113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.886132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:24.888580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 71/133] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:24 2022] GET /identity/v3/projects/f4f9fc41a1e04ba4be67781d005c9075 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:24.890603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:24.909370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 63/134] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:24 2022] PUT /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/a3ee5ad379424977ab3602ba23b1e1b6/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:24.909899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:25.093365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:25.102132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf194-e8e2-4d99-887f-4b47a5f53113 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:25.150763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded3daa-5b46-4327-929e-6d4b3fb83963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:25.151483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3daa-5b46-4327-929e-6d4b3fb83963 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:25.151764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3daa-5b46-4327-929e-6d4b3fb83963 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:25.158042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3daa-5b46-4327-929e-6d4b3fb83963 None admin] PATH_INFO: `/v3/projects/f4f9fc41a1e04ba4be67781d005c9075/users/a3ee5ad379424977ab3602ba23b1e1b6/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:25.160529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded3daa-5b46-4327-929e-6d4b3fb83963 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4f9fc41a1e04ba4be67781d005c9075, user_id=a3ee5ad379424977ab3602ba23b1e1b6, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:25.162066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded3daa-5b46-4327-929e-6d4b3fb83963 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:25.187586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 64/135] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:24 2022] PUT /identity/v3/projects/f4f9fc41a1e04ba4be67781d005c9075/users/a3ee5ad379424977ab3602ba23b1e1b6/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:25.243975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f14b-c79f-469d-b04f-b3ccac7adb59 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:25.244378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f14b-c79f-469d-b04f-b3ccac7adb59 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:25.244940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f14b-c79f-469d-b04f-b3ccac7adb59 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:25.247749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 65/136] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:25.266486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85030fec-8593-45c6-94ea-e14b4760c9f6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:25.273452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:25.273901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:25.274153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:25.346906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:25.349075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:25.403073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:25.404281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:25.404920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:25.405476 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:25.409021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:25.412087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:25.415255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 72/137] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:24 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:25.425639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:25.434613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:25.455435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 66/138] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:25.721386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bf86d-bcde-40b5-ac0a-f0a1329869ea None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:25.761503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:25.778444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:25.779534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:25.780035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:25.780506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/230f8b0dcb17425a90aa8f093d4d7ce6/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:25.793831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] RBAC: Authorizing `identity:create_grant(project_id=892640f70c834da6a9715633f0fbc7ae, user_id=230f8b0dcb17425a90aa8f093d4d7ce6, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:25.795772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:25.826542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 73/139] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:25 2022] PUT /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/230f8b0dcb17425a90aa8f093d4d7ce6/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:06:25.920119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:25.957704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04be8-decc-4453-9c64-2e59cba1de22 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:26.020746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb217f-263c-4cc3-af7a-a8ce7b8416af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:26.021347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb217f-263c-4cc3-af7a-a8ce7b8416af None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:26.021645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb217f-263c-4cc3-af7a-a8ce7b8416af None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:26.021919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb217f-263c-4cc3-af7a-a8ce7b8416af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:26.050486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb217f-263c-4cc3-af7a-a8ce7b8416af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-41bb217f-263c-4cc3-af7a-a8ce7b8416af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:26.059903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:26.060888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:26.061731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:26.062327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 67/140] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:26.069795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:26.154414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0781a-7cd5-4526-ac40-dbd43c9beea5 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:26.154703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0781a-7cd5-4526-ac40-dbd43c9beea5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:26.155036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0781a-7cd5-4526-ac40-dbd43c9beea5 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:26.156654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 68/141] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:26.166145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:26.167058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:26.167819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:26.217393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:26.220079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:26.222318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:26.272892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb99e2-1ead-42bc-9b88-af408a67714f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:26.318904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:26.319959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:26.320428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:26.320915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:26.321801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:26.322322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:26.324262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:26.335148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 74/142] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:26.342148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:26.467377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef127c-b289-47e3-b71e-4a3fe7d62388 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:26.493440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 69/143] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:26.509030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:26.515098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:26.516170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:26.516681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:26.517153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] PATH_INFO: `/v3/users/5dbf433a5acd45728d0190e988a823e2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:26.518841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] RBAC: Authorizing `identity:get_user(user_id=5dbf433a5acd45728d0190e988a823e2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:26.520862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:26.523209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 75/144] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:26 2022] GET /identity/v3/users/5dbf433a5acd45728d0190e988a823e2 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:26.530110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:26.616067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:26.660238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a3d7-cc38-4ad3-8915-68100f8fa75e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:26.704824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:26.706135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:26.706628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:26.707089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:26.708720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:26.710832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:26.713137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 70/145] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:26 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:26.720140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:26.984400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa4947-ad35-4a67-bacd-42f2ed86913e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:27.070087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:27.071245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:27.071763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:27.072787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/5dbf433a5acd45728d0190e988a823e2/roles/d02cc34f367b408fa485c7db59f0763b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:27.073621 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:27.078971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] RBAC: Authorizing `identity:create_grant(project_id=892640f70c834da6a9715633f0fbc7ae, user_id=5dbf433a5acd45728d0190e988a823e2, role_id=d02cc34f367b408fa485c7db59f0763b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:27.081995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:27.113203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 76/146] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:26 2022] PUT /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae/users/5dbf433a5acd45728d0190e988a823e2/roles/d02cc34f367b408fa485c7db59f0763b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:06:27.324087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740faf-8ecc-46c6-b88b-f26034c335f3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:27.391124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7aec-988c-4e61-9ee9-5f999037a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:27.391831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7aec-988c-4e61-9ee9-5f999037a805 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:27.392081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7aec-988c-4e61-9ee9-5f999037a805 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:27.392358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7aec-988c-4e61-9ee9-5f999037a805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:27.393819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7aec-988c-4e61-9ee9-5f999037a805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:27.395341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7aec-988c-4e61-9ee9-5f999037a805 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:27.397140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 71/147] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:27.403568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:27.496505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:27.556687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30dedb-cb77-48d4-9893-783fa512bc60 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:27.602109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcdecf-2165-4ccc-95a6-419594b7f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:27.602730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcdecf-2165-4ccc-95a6-419594b7f43d None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:27.603006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcdecf-2165-4ccc-95a6-419594b7f43d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:27.603276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcdecf-2165-4ccc-95a6-419594b7f43d None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:27.604008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcdecf-2165-4ccc-95a6-419594b7f43d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:27.605595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcdecf-2165-4ccc-95a6-419594b7f43d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:27.648660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 77/148] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:27 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:28.738692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3066a3-fa90-45cf-8674-fd563726ec94 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:28.739708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3066a3-fa90-45cf-8674-fd563726ec94 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:28.740201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3066a3-fa90-45cf-8674-fd563726ec94 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:28.741942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 72/149] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:28.749166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f671c-641f-4931-aab0-c46c6f9b1637 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:28.750149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f671c-641f-4931-aab0-c46c6f9b1637 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:28.750677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f671c-641f-4931-aab0-c46c6f9b1637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:28.776885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-688f671c-641f-4931-aab0-c46c6f9b1637 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:28.778499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-688f671c-641f-4931-aab0-c46c6f9b1637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:28.872312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 78/150] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:29.172659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808d9f6-d7e1-4a50-aaa1-a573ef414394 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:29.172938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808d9f6-d7e1-4a50-aaa1-a573ef414394 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:29.173443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808d9f6-d7e1-4a50-aaa1-a573ef414394 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:29.175022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 73/151] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:29.181040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:29.181598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:29.182044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:29.209866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:29.211477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:29.259841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:29.303613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 79/152] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:29.516496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808d9f6-d7e1-4a50-aaa1-a573ef414394 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:29.534517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:29.697883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:29.710794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808d9f6-d7e1-4a50-aaa1-a573ef414394 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:29.767100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:29.768011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:29.768253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:29.768438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:29.787727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:29.794726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:29.795811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:29.796679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:29.805399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 74/153] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:06:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:29.806757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:29.915270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:30.001487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abae8-b74f-40f0-8cb5-b788f4aeb204 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:30.028549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043c36-3742-47f9-b5ef-1da807314ccc None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:30.058423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:30.059135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.059422 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.059697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.060408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:30.060737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:30.062361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d0a8-8132-438d-a9e6-1ebf58de78b9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:30.077025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 75/154] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:06:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:30.078539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a165f2-2cf4-414f-b5d3-9b697c26491d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.078876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a165f2-2cf4-414f-b5d3-9b697c26491d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.079155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a165f2-2cf4-414f-b5d3-9b697c26491d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.080751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 76/155] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:30.081837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4401cb-d2ae-470a-a54e-9a6a1c846a49 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.082122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4401cb-d2ae-470a-a54e-9a6a1c846a49 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.082398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4401cb-d2ae-470a-a54e-9a6a1c846a49 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.084029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 77/156] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:30.084517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4401cb-d2ae-470a-a54e-9a6a1c846a49 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:30.116420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b69a-afda-4c31-8cf9-fb86dfe33516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:30.117989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b69a-afda-4c31-8cf9-fb86dfe33516 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.118522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b69a-afda-4c31-8cf9-fb86dfe33516 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.119402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b69a-afda-4c31-8cf9-fb86dfe33516 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.133564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b69a-afda-4c31-8cf9-fb86dfe33516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a267b69a-afda-4c31-8cf9-fb86dfe33516 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:30.140277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:30.141751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:30.142683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:30.145398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 80/157] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:30.147596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.148106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.148558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.183191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:30.184878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:30.236330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:30.254352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4401cb-d2ae-470a-a54e-9a6a1c846a49 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:30.300174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:30.316564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaca36a-58d9-4df4-a57c-6e31c710d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:30.317302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca36a-58d9-4df4-a57c-6e31c710d649 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.317581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca36a-58d9-4df4-a57c-6e31c710d649 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.317862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca36a-58d9-4df4-a57c-6e31c710d649 None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.319073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaca36a-58d9-4df4-a57c-6e31c710d649 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:30.320586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaca36a-58d9-4df4-a57c-6e31c710d649 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:30.322499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 78/158] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:30 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:30.323529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.323814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.324101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.333999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 81/159] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:30.335262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:30.361211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:30.361788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:30.481278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 79/160] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:30.482036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:30.626762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a1aa9-4d48-4339-b7cc-56383e46e2ad None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:30.671302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24629e1-eda8-45ff-bfcd-d291b533dafd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:30.697343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:30.698647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.699139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.699600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.700854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:30.701603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:30.704660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:30.724335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 82/161] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:30.734333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:30.747300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:30.764709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:30.765354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:30.765636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:30.766029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:30.796334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:30.909813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:30.912091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:30.946222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99864-5c90-4d0d-94df-23c786a166a8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:31.009357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:31.010756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:31.011224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:31.011686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:31.014151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:31.017143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:31.020282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 83/162] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:30 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:31.021680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:31.220167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 80/163] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:31.221679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:31.234432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:31.251785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e433-9b75-49bc-a7e8-e26c3bbcebaf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:31.312325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:31.360588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:31.361738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:31.362028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:31.362297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:31.393919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:31.399004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:31.400974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:31.402721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 84/164] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:31.406277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:31.508523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc8b0-d52a-4a58-ab61-e3990f2a7084 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:31.586580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:31.587192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:31.587488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:31.587765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:31.651690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f3015-c83c-4fcb-a86d-0d13c88bcfba None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:31.696496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:31.698065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:31.717597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:31.718262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:31.718545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:31.718803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:31.722665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:31.724346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:31.726179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 85/165] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:31 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:31.726999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:31.740658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:31.778551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:31.827804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 81/166] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:31.828647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:31.958510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4b75-1bc4-406c-9d02-bfa150205458 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:32.003936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:32.004582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.005032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.005381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.006079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:32.006383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:32.007844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890dbd1-ea63-411b-b84d-0a543e01d994 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:32.017111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:32.020499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 82/167] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:32.021895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9933d-9ecc-43cd-b37f-45c6e340ac4a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.022339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9933d-9ecc-43cd-b37f-45c6e340ac4a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.022722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9933d-9ecc-43cd-b37f-45c6e340ac4a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.024276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 83/168] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:32.025048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9933d-9ecc-43cd-b37f-45c6e340ac4a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:32.059947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88632ed2-5202-4ae5-b7f9-9ee6896da3a4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:32.147405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:32.148399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.148842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.149247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.171255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:32.181810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:32.182945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:32.183861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:32.191265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 86/169] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:32.192411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:32.261986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9933d-9ecc-43cd-b37f-45c6e340ac4a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:32.345168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:32.346071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.346491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.346917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.347806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] RBAC: Adding query filter params (role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=a3ee5ad379424977ab3602ba23b1e1b6) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:32.349498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:32.351250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82a5b7-d64f-4374-92a3-73778925a9c7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:32.371115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 84/170] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:32 2022] GET /identity/v3/role_assignments?user.id=a3ee5ad379424977ab3602ba23b1e1b6&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:32.372759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.375110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.375772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.382193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:32.425437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ee91-d693-4b94-bf3b-0459b5fb40c7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:32.430549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:32.432708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:32.478500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:32.479643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.481233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.482069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.484326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:32.487877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:32.491282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 87/171] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:32 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:32.495730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:32.594811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:32.658226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf21ce-ca70-406c-9c85-fe262388404b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:32.687576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 85/172] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:32.689628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:32.708361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:32.709554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.710009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.710414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] PATH_INFO: `/v3/users/a3ee5ad379424977ab3602ba23b1e1b6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.717689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] RBAC: Authorizing `identity:get_user(user_id=a3ee5ad379424977ab3602ba23b1e1b6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:32.719572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:32.722285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 88/173] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:32 2022] GET /identity/v3/users/a3ee5ad379424977ab3602ba23b1e1b6 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:32.723583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:32.753499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:32.879448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342a54-e0a1-4d32-b4ae-153a2377038d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:32.933959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:32.934921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:32.935401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:32.935873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:32.937452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=a3ee5ad379424977ab3602ba23b1e1b6) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:32.938017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:32.940668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:32.954451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 89/174] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:32 2022] GET /identity/v3/role_assignments?user.id=a3ee5ad379424977ab3602ba23b1e1b6&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:32.955989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:33.081409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180fb48-5cf4-4246-b345-ee2f2e71af1b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:33.217258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:33.230710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:33.231786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.232290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.232815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.234129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:33.234759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:33.238086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b2273-79a2-48b4-89e0-2b67b343cec5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:33.255534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c653ea-29ef-4126-ad93-fe54fbc202e8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:33.268784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 86/175] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 581 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:33.271256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41899-0862-45fa-a249-a75c3c90d1e5 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.271656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41899-0862-45fa-a249-a75c3c90d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.272133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41899-0862-45fa-a249-a75c3c90d1e5 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.282747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 87/176] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:33.283074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41899-0862-45fa-a249-a75c3c90d1e5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:33.309344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff96d1-f303-40c1-b08c-9e009a3fe232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:33.310354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff96d1-f303-40c1-b08c-9e009a3fe232 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.310846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff96d1-f303-40c1-b08c-9e009a3fe232 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.311447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff96d1-f303-40c1-b08c-9e009a3fe232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.400070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:33.440201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff96d1-f303-40c1-b08c-9e009a3fe232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:33.441777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff96d1-f303-40c1-b08c-9e009a3fe232 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:33.497444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41899-0862-45fa-a249-a75c3c90d1e5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:33.550364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137a36-9004-4d0f-a85f-c245a5f4aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:33.551092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137a36-9004-4d0f-a85f-c245a5f4aa15 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.551418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137a36-9004-4d0f-a85f-c245a5f4aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.551683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137a36-9004-4d0f-a85f-c245a5f4aa15 None admin] PATH_INFO: `/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.553721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c137a36-9004-4d0f-a85f-c245a5f4aa15 None admin] RBAC: Authorizing `identity:get_user(user_id=230f8b0dcb17425a90aa8f093d4d7ce6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:33.555387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:33.555972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c137a36-9004-4d0f-a85f-c245a5f4aa15 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:33.558217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 88/177] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:33 2022] GET /identity/v3/users/230f8b0dcb17425a90aa8f093d4d7ce6 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:33.560154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.560435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.560841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.584601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 90/178] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:33.585561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:33.586603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1829a-1738-47fe-80d6-6282bd48fa4a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.586798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:33.587312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1829a-1738-47fe-80d6-6282bd48fa4a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.587776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1829a-1738-47fe-80d6-6282bd48fa4a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.589536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 91/179] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:33.593759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1829a-1738-47fe-80d6-6282bd48fa4a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:33.694978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 89/180] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:33.696042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:33.769135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:33.782668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1829a-1738-47fe-80d6-6282bd48fa4a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:33.833182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:33.834288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.834574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.834845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.844348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f749-7a60-44c7-ac99-e4dc599d2304 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:33.850330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:33.855398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:33.857674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 92/181] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:33.859472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:33.905451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:33.906580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:33.907667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:33.907667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:33.914516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:33.989418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3e52-2d73-4456-91d9-37e992279650 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.028439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9cea6-7723-43bd-b183-71e30b2a1888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.029038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cea6-7723-43bd-b183-71e30b2a1888 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.029318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cea6-7723-43bd-b183-71e30b2a1888 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.029682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cea6-7723-43bd-b183-71e30b2a1888 None admin] PATH_INFO: `/v3/projects/f4f9fc41a1e04ba4be67781d005c9075` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.030788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9cea6-7723-43bd-b183-71e30b2a1888 None admin] RBAC: Authorizing `identity:get_project(project_id=f4f9fc41a1e04ba4be67781d005c9075)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.031139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.035816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.036034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9cea6-7723-43bd-b183-71e30b2a1888 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.036235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 93/182] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:33 2022] GET /identity/v3/projects/f4f9fc41a1e04ba4be67781d005c9075 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:34.037565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed893a-9b55-4cb7-9329-f402ab7a1aa2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.037845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed893a-9b55-4cb7-9329-f402ab7a1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.038117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed893a-9b55-4cb7-9329-f402ab7a1aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.058946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f6ed893a-9b55-4cb7-9329-f402ab7a1aa2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:34.060188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f6ed893a-9b55-4cb7-9329-f402ab7a1aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:34.105467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:34.137043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 94/183] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:34.140844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef5ad-21c1-4ddf-97fa-2f8bdfaa630c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.140844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef5ad-21c1-4ddf-97fa-2f8bdfaa630c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.140844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef5ad-21c1-4ddf-97fa-2f8bdfaa630c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.143654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 95/184] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:34.145086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ef5ad-21c1-4ddf-97fa-2f8bdfaa630c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.205759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:34.211454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 90/185] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:34.213481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.334692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ef5ad-21c1-4ddf-97fa-2f8bdfaa630c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.337083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e3ff5-2af7-472d-b5ec-bb34f96250a2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.383216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.383849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.384125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.384777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.385451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:34.385752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.387213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.389361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.390347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.390825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.392462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.393830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=f4f9fc41a1e04ba4be67781d005c9075, user.id=a3ee5ad379424977ab3602ba23b1e1b6) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:34.394384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.396923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a744ef-9fd0-4259-b932-c45f86c7c8a8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.397178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 96/186] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:34.402024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.412146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 91/187] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/role_assignments?user.id=a3ee5ad379424977ab3602ba23b1e1b6&scope.project.id=f4f9fc41a1e04ba4be67781d005c9075&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:34.412146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.412146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.412146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.426814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:34.434030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:34.435428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:34.528164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 92/188] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:34.530687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.577103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:34.583205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e0809-18cd-42f6-ab1a-bdb383080d11 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.647873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.649328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.649993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.650682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.673984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:34.684601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:34.686145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:34.687891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:34.693905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 97/189] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:34.693905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.707062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1899b-811f-48e2-a95b-fb5647df57dd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.749984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.750874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.751217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.751506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.753029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.754619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.760745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 93/190] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:34.760745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.766474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:34.858182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b2325-35d0-4141-8abf-16f444d38836 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.906268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.907940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.908349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.908765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] PATH_INFO: `/v3/users/5dbf433a5acd45728d0190e988a823e2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.910409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] RBAC: Authorizing `identity:get_user(user_id=5dbf433a5acd45728d0190e988a823e2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.912338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.914320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 98/191] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/users/5dbf433a5acd45728d0190e988a823e2 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:34.915280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:34.916936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497cdcf-c16d-4f78-8f19-0b55d507bdce None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:34.957412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:34.971584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:34.972377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:34.972784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:34.973144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:34.974491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:34.976079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:34.978053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 94/192] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:34.979031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.064170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefae61-5430-4cc1-8988-bfd1d63ff80a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.079167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:35.115442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.116224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.116562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.116921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.117724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:35.118076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:35.119625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:35.125520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10de3-5135-489a-9d34-79270419b2f6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.132546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 99/193] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:35.133668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.176479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.177219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.177575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.177952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.178791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=230f8b0dcb17425a90aa8f093d4d7ce6) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:35.179188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:35.180901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:35.188774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 95/194] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:34 2022] GET /identity/v3/role_assignments?user.id=230f8b0dcb17425a90aa8f093d4d7ce6&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:35.189678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.258419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:35.276642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f213104-971d-432a-a71e-b1499d41f87d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.323388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.324330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.324782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.325236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.336285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9b392-66c9-4d2a-896e-a29597f70260 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.340396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:35.346909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:35.348741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:35.350276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 100/195] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:06:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:35.353265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.392767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.393414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.393740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.394015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.399634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:35.519360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:35.520843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:35.538855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65a7ea-af89-4eec-bc36-52f580fe6ab8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.584559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.585590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.585590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.585838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.586452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:35.587992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:35.614147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 101/196] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:35 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:35.622289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.628453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:35.718242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 96/197] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:35.719936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.798940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:35.842934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b62de-0696-4b99-999c-86e029b12c38 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.917362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.918726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.919370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d865a-9298-4d14-bea5-10545f8fe896 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:35.922796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.922796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] PATH_INFO: `/v3/users/254fc9e6cae94955aee69e4a2a383efc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.957776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] RBAC: Authorizing `identity:get_user(user_id=254fc9e6cae94955aee69e4a2a383efc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:35.961126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:35.964459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 102/198] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:35 2022] GET /identity/v3/users/254fc9e6cae94955aee69e4a2a383efc => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:35.965827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:35.992997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:35.993987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:35.994606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:35.995061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:35.996226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:35.997430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:35.999229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:36.022258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 97/199] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:06:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:36.023175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:36.102872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:36.207858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea9fe-a467-46bb-b675-40655255560b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:36.224345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:36.233769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e624bae-9f43-4002-9711-f6361768891f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:36.272431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:36.273142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:36.273420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:36.273688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:36.274922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:36.277377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:36.286743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 103/200] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:35 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:36.287812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:36.296219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:36.296917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:36.297696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:36.297987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:36.419338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:36.422057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:36.424421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4866d-e9ab-4c40-a16b-1f4ea1e02609 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:36.470909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:36.471627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:36.471913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:36.472167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] PATH_INFO: `/v3/users/254fc9e6cae94955aee69e4a2a383efc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:36.475363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] RBAC: Authorizing `identity:get_user(user_id=254fc9e6cae94955aee69e4a2a383efc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:36.475363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:36.478525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 104/201] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:36 2022] GET /identity/v3/users/254fc9e6cae94955aee69e4a2a383efc => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:36.478525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:36.496325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:36.600732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:36.607066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 98/202] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:36.608665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:36.614190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb4ff-5eba-4821-ad15-2746a1debc77 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:36.672199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:36.673160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:36.673619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:36.674073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:36.675473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] RBAC: Adding query filter params (role.id=d02cc34f367b408fa485c7db59f0763b, scope.project.id=892640f70c834da6a9715633f0fbc7ae, user.id=5dbf433a5acd45728d0190e988a823e2) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:36.677310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:36.678951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:36.697049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 105/203] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:36 2022] GET /identity/v3/role_assignments?user.id=5dbf433a5acd45728d0190e988a823e2&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=d02cc34f367b408fa485c7db59f0763b => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:36.699097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:36.892766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:36.899903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba071b6-c5a4-4c35-af92-8d643afcb113 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:36.972210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ca18c-fab7-4d5f-ad46-cfc7c72e8e98 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:37.005469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:37.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:37.006996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:37.007253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:37.016912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:37.017969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:37.018443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:37.018930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:37.020524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:37.022273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:37.024359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 106/204] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:36 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:37.041138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:37.102111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:37.106540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:37.108548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:37.252206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0eea-93c1-4bca-b2e6-9729f98e4a12 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:37.252456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 99/205] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:37.265894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:37.326344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:37.338762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:37.339817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:37.340280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:37.341626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:37.343104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=254fc9e6cae94955aee69e4a2a383efc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:37.343625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:37.347069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:37.360616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 107/206] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:37 2022] GET /identity/v3/role_assignments?user.id=254fc9e6cae94955aee69e4a2a383efc&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:37.496842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:37.505742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2373d-4e77-4dd9-b7a0-dd4b0fa21fae None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:37.574958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef4945-14ac-44cd-bef8-4f655a95f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:37.576028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef4945-14ac-44cd-bef8-4f655a95f9eb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:37.576510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef4945-14ac-44cd-bef8-4f655a95f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:37.577030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef4945-14ac-44cd-bef8-4f655a95f9eb None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:37.579281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef4945-14ac-44cd-bef8-4f655a95f9eb None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:37.582180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef4945-14ac-44cd-bef8-4f655a95f9eb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:37.585917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 100/207] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:37 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:37.594483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:37.791851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4c33-3651-40d1-80ae-610f2700e73c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:37.858274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:37.859390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:37.859950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:37.860378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:37.861750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] RBAC: Adding query filter params (role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=254fc9e6cae94955aee69e4a2a383efc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:37.862412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:37.865546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c9cb-3ad0-47a9-89e2-626fce5838f1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:37.876810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 108/208] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:37 2022] GET /identity/v3/role_assignments?user.id=254fc9e6cae94955aee69e4a2a383efc&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:38.423292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804fbd-00a6-4d57-b271-a4a14bdca4d0 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:38.424307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804fbd-00a6-4d57-b271-a4a14bdca4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:38.424307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804fbd-00a6-4d57-b271-a4a14bdca4d0 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:38.425628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 101/209] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:38.431649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:38.432016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:38.432267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:38.454606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:38.455891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:38.530675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:38.548205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 109/210] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:38.822452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804fbd-00a6-4d57-b271-a4a14bdca4d0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:38.993748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804fbd-00a6-4d57-b271-a4a14bdca4d0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:39.058486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01617-224c-4903-bd22-e5af7c4d8045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:39.059518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01617-224c-4903-bd22-e5af7c4d8045 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.059956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01617-224c-4903-bd22-e5af7c4d8045 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.060407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01617-224c-4903-bd22-e5af7c4d8045 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.078514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c01617-224c-4903-bd22-e5af7c4d8045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-32c01617-224c-4903-bd22-e5af7c4d8045 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:39.084969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:39.085969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:39.086787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:39.087458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 102/211] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:39.093017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:39.215052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1ae96-8977-4dfb-a7ab-ef1944cabead None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:39.236983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35885c8-8f77-454b-adee-1674859c16c6 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.237317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35885c8-8f77-454b-adee-1674859c16c6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.237543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35885c8-8f77-454b-adee-1674859c16c6 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.239336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 103/212] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:39.246998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.247426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.247802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.270916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:39.271710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.272162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.272616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.273000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:39.273568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:39.273924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:39.274586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:39.276290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:39.293324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 110/213] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:39.302781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:39.314494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:39.392786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 104/214] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:39.420870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:39.511445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908b2a0-c524-4b49-88f0-359184ba10c7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:39.583748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7e854-d9bd-438c-b958-b53cff25778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:39.584864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e854-d9bd-438c-b958-b53cff25778e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.585345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e854-d9bd-438c-b958-b53cff25778e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.585825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e854-d9bd-438c-b958-b53cff25778e None admin] PATH_INFO: `/v3/users/dad4be00e91e4f27a0bf3c1eed85f1af` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.613319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7e854-d9bd-438c-b958-b53cff25778e None admin] RBAC: Authorizing `identity:get_user(user_id=dad4be00e91e4f27a0bf3c1eed85f1af)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:39.616096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7e854-d9bd-438c-b958-b53cff25778e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:39.624813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 111/215] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:39 2022] GET /identity/v3/users/dad4be00e91e4f27a0bf3c1eed85f1af => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:39.629508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:39.771785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4863-95ca-4e4a-8222-5dd5f237bb4c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.772192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4863-95ca-4e4a-8222-5dd5f237bb4c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.772690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4863-95ca-4e4a-8222-5dd5f237bb4c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.775966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 112/216] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:39.785757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.786389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.787014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.816946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:39.818830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:39.841643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8312a48-8933-45bc-b5b4-268f60797c96 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:39.930965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9161f-883c-4713-89e1-784fb69d7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:39.932080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9161f-883c-4713-89e1-784fb69d7d16 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:39.932567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9161f-883c-4713-89e1-784fb69d7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:39.933073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9161f-883c-4713-89e1-784fb69d7d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:39.964759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 113/217] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:39.966705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:39.993220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:40.060535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:40.099185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9161f-883c-4713-89e1-784fb69d7d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:40.104114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9161f-883c-4713-89e1-784fb69d7d16 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:40.193575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba933-b2b0-4e62-b4d6-65b517ba6d7f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:40.266101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbff636-cdc4-4ad1-82b7-5dcba951e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:40.266569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbff636-cdc4-4ad1-82b7-5dcba951e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.266866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbff636-cdc4-4ad1-82b7-5dcba951e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.266991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbff636-cdc4-4ad1-82b7-5dcba951e4c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.268719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbff636-cdc4-4ad1-82b7-5dcba951e4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:40.271097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbff636-cdc4-4ad1-82b7-5dcba951e4c5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:40.273804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 114/218] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:40.275906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e48d-d930-4846-804c-11099d19003e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.276540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e48d-d930-4846-804c-11099d19003e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.276875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e48d-d930-4846-804c-11099d19003e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.279670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 115/219] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:40.285801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e48d-d930-4846-804c-11099d19003e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:40.309857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 105/220] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:40.312480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228787a8-afba-4b2f-8403-554357dba947 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.313340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228787a8-afba-4b2f-8403-554357dba947 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.314004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228787a8-afba-4b2f-8403-554357dba947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.345730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-228787a8-afba-4b2f-8403-554357dba947 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:40.347648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-228787a8-afba-4b2f-8403-554357dba947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:40.417944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:40.445033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 106/221] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:40.446095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228787a8-afba-4b2f-8403-554357dba947 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:40.483990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e48d-d930-4846-804c-11099d19003e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:40.502059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:40.560561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:40.561517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.562422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.563172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.564390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:40.567098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:40.595737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228787a8-afba-4b2f-8403-554357dba947 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:40.605219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 116/222] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:40 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:40.616516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:40.677587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:40.679697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.680255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.681163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.684156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:40.688367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:40.693446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 107/223] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:40 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:40.702552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:40.814849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:40.836167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586c85-5af6-4ae8-b0ab-c0367e3affc2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:40.893485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e10d-4bd7-4390-b047-e92108648aba None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:40.895551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:40.896640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.897035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.897480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.924234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:40.933659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:40.936969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 117/224] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:40.939220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:40.965508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:40.967055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:40.967055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:40.967055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:40.968181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=dad4be00e91e4f27a0bf3c1eed85f1af) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:40.969526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:40.971243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:40.984815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 108/225] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:40 2022] GET /identity/v3/role_assignments?user.id=dad4be00e91e4f27a0bf3c1eed85f1af&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:40.986333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:40.987716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:41.089078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25d8b0-0c2c-4769-8410-338a1a239b78 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:41.130815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:41.131841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:41.132439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:41.132749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:41.147315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:41.153701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:41.155275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:41.156789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 118/226] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:06:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:41.161765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:41.234182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c40fc-786d-453f-bbc7-59a072dcba18 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:41.260390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:41.294780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5304775-ab08-472e-8361-62219326163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:41.298266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5304775-ab08-472e-8361-62219326163a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:41.298266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5304775-ab08-472e-8361-62219326163a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:41.298784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5304775-ab08-472e-8361-62219326163a None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:41.299972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5304775-ab08-472e-8361-62219326163a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:41.300492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5304775-ab08-472e-8361-62219326163a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:41.303043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5304775-ab08-472e-8361-62219326163a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:41.322183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:41.322802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 109/227] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:41.333408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5304775-ab08-472e-8361-62219326163a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:41.363305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4fb9-79d9-4a86-9ccc-b3a88b36d7dd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:41.445503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:41.446700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:41.447284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:41.447903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:41.451206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:41.451877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:41.457255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:41.483964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 119/228] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:06:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:41.490765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:41.632745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5304775-ab08-472e-8361-62219326163a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:41.705652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:41.707036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:41.707631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:41.708294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] PATH_INFO: `/v3/users/254fc9e6cae94955aee69e4a2a383efc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:41.710527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] RBAC: Authorizing `identity:get_user(user_id=254fc9e6cae94955aee69e4a2a383efc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:41.715610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:41.717519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 110/229] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:41 2022] GET /identity/v3/users/254fc9e6cae94955aee69e4a2a383efc => generated 283 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:41.726248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:41.776181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf5f18-fd6d-46e6-884c-9a53a6c532aa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:41.839577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:41.840205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:41.840486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:41.840790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] PATH_INFO: `/v3/users/254fc9e6cae94955aee69e4a2a383efc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:41.843982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:41.845757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] RBAC: Authorizing `identity:get_user(user_id=254fc9e6cae94955aee69e4a2a383efc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:41.847222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:41.849132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 120/230] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:41 2022] GET /identity/v3/users/254fc9e6cae94955aee69e4a2a383efc => generated 283 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:41.855223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:41.881598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:42.008864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4c3a7-54dd-4c4f-b4d3-fca2477daeca None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:42.105557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:42.107605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:42.109046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:42.109443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:42.118252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:42.120980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:42.129040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 111/231] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:41 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:42.142463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:42.146590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02f246-db59-4262-ba66-927574cb19f3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:42.214042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:42.215557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:42.216303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:42.217071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:42.222694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:42.226019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:42.236710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 121/232] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:41 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:42.242776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:42.439746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6adf5d-a86c-4b85-beb5-db9b5d4129d7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:42.454034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:42.473093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:42.485558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8484f-c8d7-415c-8d26-deaff226941d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:42.522266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f2e87-7ee2-49ed-96f9-aacda2ca1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:42.522974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2e87-7ee2-49ed-96f9-aacda2ca1713 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:42.523259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2e87-7ee2-49ed-96f9-aacda2ca1713 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:42.523534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f2e87-7ee2-49ed-96f9-aacda2ca1713 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/254fc9e6cae94955aee69e4a2a383efc/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:42.526738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f2e87-7ee2-49ed-96f9-aacda2ca1713 None admin] RBAC: Authorizing `identity:create_grant(project_id=41167c2035b74c5ca9df5ba5e1c86757, user_id=254fc9e6cae94955aee69e4a2a383efc, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:42.528552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f2e87-7ee2-49ed-96f9-aacda2ca1713 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:42.554890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c100-3699-4ad7-a35e-1db17b2e0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:42.557175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 112/233] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:42 2022] PUT /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/254fc9e6cae94955aee69e4a2a383efc/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:06:42.557915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c100-3699-4ad7-a35e-1db17b2e0912 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:42.558841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c100-3699-4ad7-a35e-1db17b2e0912 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:42.559590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c100-3699-4ad7-a35e-1db17b2e0912 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/254fc9e6cae94955aee69e4a2a383efc/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:42.568197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4c100-3699-4ad7-a35e-1db17b2e0912 None admin] RBAC: Authorizing `identity:create_grant(project_id=41167c2035b74c5ca9df5ba5e1c86757, user_id=254fc9e6cae94955aee69e4a2a383efc, role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:42.571707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4c100-3699-4ad7-a35e-1db17b2e0912 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:42.620892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 122/234] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:42 2022] PUT /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/254fc9e6cae94955aee69e4a2a383efc/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:44.014931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621e5c-2cd2-4288-bcca-14c5e8b6886b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.015868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621e5c-2cd2-4288-bcca-14c5e8b6886b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.015868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621e5c-2cd2-4288-bcca-14c5e8b6886b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.017354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 113/235] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:44.023643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.024419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.024419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.048505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:44.049835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:44.051909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503276-8aee-4253-a00e-03cebf9666fb None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.052286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503276-8aee-4253-a00e-03cebf9666fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.052517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503276-8aee-4253-a00e-03cebf9666fb None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.054194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 114/236] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:44.074650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08384b-8095-4af5-9c7f-4d3e1c776654 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.075056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08384b-8095-4af5-9c7f-4d3e1c776654 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.075206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08384b-8095-4af5-9c7f-4d3e1c776654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.110711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0b08384b-8095-4af5-9c7f-4d3e1c776654 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:44.113634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0b08384b-8095-4af5-9c7f-4d3e1c776654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:44.159231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 123/237] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:44.279520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 115/238] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:44.446815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:44.470735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a054b-865b-4eda-9d90-2f727d9baf34 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.471197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a054b-865b-4eda-9d90-2f727d9baf34 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.471675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a054b-865b-4eda-9d90-2f727d9baf34 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.474529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 116/239] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:44.480257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.480517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.480859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.521779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:44.523025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:44.533340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:44.565102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf58fa-36e8-4068-affb-d460549ae8ed None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:44.606448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:44.607121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.607401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.608043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.620576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:44.626616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:44.628451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:44.630850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 124/240] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:44.635464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:44.755662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923764-2357-4e9c-8069-3a79c03e089e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:44.799635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:44.800175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:44.800453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:44.800784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:44.801485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:44.801789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:44.803250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:44.806458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 117/241] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:44.810322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:44.814607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 125/242] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:44.821035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:44.885531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:44.892073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:45.054819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4f51f-3ea4-42a3-b5e5-8bf37b7e8454 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.135887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.137535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.138757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.139574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] PATH_INFO: `/v3/users/389eb93187424c41b160617515f83588` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.174011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] RBAC: Authorizing `identity:get_user(user_id=389eb93187424c41b160617515f83588)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:45.177378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:45.182364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 118/243] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:44 2022] GET /identity/v3/users/389eb93187424c41b160617515f83588 => generated 297 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:45.191467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:45.233248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175e9c3-e121-49b8-8d24-d00ab834b06f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.277776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.278438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.278724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.278998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.292345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:45.299175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:45.309079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 126/244] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:45.310725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:45.373579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:45.407349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:45.422813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdef681-9808-4f8d-a570-6151bd0afe33 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.429330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7e43-bfad-45bc-bf30-29312e7e12a0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.469425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.470410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.470629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.470909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.472131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:45.473698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:45.475811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 127/245] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:45.476395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:45.492085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.492746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.493029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.493290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.588774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:45.590324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:45.624604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35f063-bcc2-4fe7-a350-85389fc7f9a3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.658846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:45.683496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.684518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.685035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.685482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.686641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:45.687246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:45.690410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a544e-5b58-4d2c-ad91-28abd30c3fed None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:45.706269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 128/246] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:45.708525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da332c1d-db44-43d1-9150-084956a7daca None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.709048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da332c1d-db44-43d1-9150-084956a7daca None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.709518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da332c1d-db44-43d1-9150-084956a7daca None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.712148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 129/247] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:45.713441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da332c1d-db44-43d1-9150-084956a7daca None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:45.716659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:45.726643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 119/248] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:45.729729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:45.858833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583ab9b-784b-4021-b2d7-d383e860c863 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.880922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da332c1d-db44-43d1-9150-084956a7daca None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:45.905193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bb4c2-d48d-48fe-9357-72c78660fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.906022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bb4c2-d48d-48fe-9357-72c78660fea7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.906571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bb4c2-d48d-48fe-9357-72c78660fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.906977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bb4c2-d48d-48fe-9357-72c78660fea7 None admin] PATH_INFO: `/v3/users/dad4be00e91e4f27a0bf3c1eed85f1af` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.908832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bb4c2-d48d-48fe-9357-72c78660fea7 None admin] RBAC: Authorizing `identity:get_user(user_id=dad4be00e91e4f27a0bf3c1eed85f1af)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:45.910705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bb4c2-d48d-48fe-9357-72c78660fea7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:45.913344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 120/249] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:45 2022] GET /identity/v3/users/dad4be00e91e4f27a0bf3c1eed85f1af => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:45.914730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.915162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.915556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.937475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:45.938538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:45.939029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:45.939500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:45.940534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:45.942900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:45.943312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:45.944869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:45.974011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 130/250] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:45 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:45.974965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:46.050715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:46.056843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:46.078293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 121/251] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:46.080136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:46.170262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147edb3-4b68-4d53-a253-3ba446fdde04 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:46.213385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b8ea-58ab-449a-9ef2-98fef174651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:46.214475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b8ea-58ab-449a-9ef2-98fef174651a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.215001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b8ea-58ab-449a-9ef2-98fef174651a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.215378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b8ea-58ab-449a-9ef2-98fef174651a None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.216803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b8ea-58ab-449a-9ef2-98fef174651a None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:46.219182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b8ea-58ab-449a-9ef2-98fef174651a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:46.222069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 131/252] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:45 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:46.223635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457eef-e5be-4ed9-8630-3aee86f5b44c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.224014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457eef-e5be-4ed9-8630-3aee86f5b44c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.224381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457eef-e5be-4ed9-8630-3aee86f5b44c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.229586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 132/253] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:46.232308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457eef-e5be-4ed9-8630-3aee86f5b44c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:46.255691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ad78-8254-40bc-ab26-92c34b043d55 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:46.311806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db2f0-9e94-444a-8f29-404376b8047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:46.312902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db2f0-9e94-444a-8f29-404376b8047d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.313360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db2f0-9e94-444a-8f29-404376b8047d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.313792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db2f0-9e94-444a-8f29-404376b8047d None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.315277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db2f0-9e94-444a-8f29-404376b8047d None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:46.317009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db2f0-9e94-444a-8f29-404376b8047d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:46.318971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 122/254] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:46 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:46.320517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.320976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.321407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.342073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:46.343743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:46.377787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457eef-e5be-4ed9-8630-3aee86f5b44c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:46.389039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:46.419556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:46.434936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 123/255] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:46.435863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:46.440050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:46.441746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.442065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.442755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.444246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] RBAC: Adding query filter params (role.id=d02cc34f367b408fa485c7db59f0763b, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=389eb93187424c41b160617515f83588) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:46.445059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:46.448361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:46.460905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 133/256] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:46 2022] GET /identity/v3/role_assignments?user.id=389eb93187424c41b160617515f83588&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=d02cc34f367b408fa485c7db59f0763b => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:46.462801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:46.690685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88902c82-005e-48a5-83d1-1ca3534cea66 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:46.804860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:46.806589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.807230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.807820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/dad4be00e91e4f27a0bf3c1eed85f1af/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.813076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=41167c2035b74c5ca9df5ba5e1c86757, user_id=dad4be00e91e4f27a0bf3c1eed85f1af, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:46.816842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:46.820786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae9e4-ae2a-49bb-9a0e-a9ecfbee82f0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:46.849005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 124/257] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:46 2022] PUT /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/dad4be00e91e4f27a0bf3c1eed85f1af/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:46.849005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:46.952973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:46.954549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:46.955283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:46.955945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:46.989206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:47.013813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:47.036322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:47.038347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:47.040125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 134/258] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 574 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:47.053732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:47.100583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2d0cc-adea-41cb-89dd-fd97358704b0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:47.174352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:47.175550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:47.176098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:47.176654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:47.193169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:47.196722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:47.205737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:47.207426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:47.208742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 125/259] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:06:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:47.219909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:47.386333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756d62-7b67-4b95-84d3-27a5b1bc0d7b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:47.439878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952797d-568b-4ef0-915c-cc827e54e28e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:47.453112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:47.454139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:47.454614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:47.455083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:47.456356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:47.456852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:47.459383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:47.466795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:47.475601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 135/260] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:47.486294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:47.510767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:47.511939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:47.512425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:47.512922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:47.514123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:47.514658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:47.517403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:47.555797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 126/261] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:06:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:47.565713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:47.871112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb108fac-6bf6-4c65-9acd-5ea038636da5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:47.905151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:47.921068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ff87b-b19d-453a-8ddc-a14eb7bea20f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:47.938203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:47.939038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:47.939298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:47.939565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] PATH_INFO: `/v3/users/254fc9e6cae94955aee69e4a2a383efc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:47.945512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=254fc9e6cae94955aee69e4a2a383efc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:47.947026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:47.949208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 136/262] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:47 2022] GET /identity/v3/users/254fc9e6cae94955aee69e4a2a383efc => generated 283 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:47.957765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:48.025757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:48.026817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:48.027297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:48.027766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] PATH_INFO: `/v3/users/254fc9e6cae94955aee69e4a2a383efc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:48.029925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] RBAC: Authorizing `identity:get_user(user_id=254fc9e6cae94955aee69e4a2a383efc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:48.033490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:48.040472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 127/263] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:47 2022] GET /identity/v3/users/254fc9e6cae94955aee69e4a2a383efc => generated 283 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:48.044893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:48.130926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:48.267183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbc79-c6d9-4a46-a7ca-50490f029f35 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:48.274899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506c411-1dd1-4a86-94b3-fa016f3ab7d1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:48.337602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:48.338663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:48.339161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:48.339613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:48.397892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:48.398837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:48.399324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:48.399782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:48.521174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:48.613798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:48.624332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:48.658411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:48.664284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:48.772658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:48.869223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 137/264] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 912 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:48.875171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:49.016322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 128/265] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 971 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:49.024720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:49.057059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:49.236446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97768671-ebc6-4d37-b3ed-2d3cef8058cd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:49.339964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a587af5-59c4-40dd-ab98-fc041728a360 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:49.358098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:49.359285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:49.359757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:49.360216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:49.362570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:49.369986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:49.378161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 138/266] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:48 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:49.379958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:49.418528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:49.419589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:49.420075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:49.420556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:49.426148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:49.429000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:49.440163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 129/267] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:49 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:49.463296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:49.497723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:49.722950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6170df-78b3-4bdf-b350-de6887f8c6de None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:49.790276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:49.806787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0cfd-6f9b-4ddc-a0ef-1c5ba4260385 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:49.814521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:49.815175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:49.815453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:49.815729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:49.816612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=254fc9e6cae94955aee69e4a2a383efc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:49.817026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:49.818664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b606-339f-4174-a927-965cdb5980bf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:49.834954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 139/268] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:49 2022] GET /identity/v3/role_assignments?user.id=254fc9e6cae94955aee69e4a2a383efc&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:49.887758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288207de-0ab3-4f45-9bac-9649a6acde0a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:49.888205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288207de-0ab3-4f45-9bac-9649a6acde0a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:49.888503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288207de-0ab3-4f45-9bac-9649a6acde0a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:49.890462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 140/269] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:49.900218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b0ee4-d673-4e2c-ab40-127881583352 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:49.900470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b0ee4-d673-4e2c-ab40-127881583352 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:49.900840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b0ee4-d673-4e2c-ab40-127881583352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:49.913893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:49.915609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:49.916394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:49.917165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:49.918883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] RBAC: Adding query filter params (role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=254fc9e6cae94955aee69e4a2a383efc) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:49.919689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:49.922597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80023-6e7e-43cd-ac9a-7c3592906b1b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:49.943175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a49b0ee4-d673-4e2c-ab40-127881583352 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:49.944498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a49b0ee4-d673-4e2c-ab40-127881583352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:49.945373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 130/270] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:49 2022] GET /identity/v3/role_assignments?user.id=254fc9e6cae94955aee69e4a2a383efc&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 608 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:50.133272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 141/271] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:50.450913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac18b-9bb5-4b62-ab3e-6448ea354e61 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:50.451765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac18b-9bb5-4b62-ab3e-6448ea354e61 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:50.451910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac18b-9bb5-4b62-ab3e-6448ea354e61 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:50.454607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 131/272] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:50.463503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c1997-f7ca-4c66-940d-68b3b0163873 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:50.464501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c1997-f7ca-4c66-940d-68b3b0163873 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:50.465242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c1997-f7ca-4c66-940d-68b3b0163873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:50.505052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9b0c1997-f7ca-4c66-940d-68b3b0163873 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:50.507603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9b0c1997-f7ca-4c66-940d-68b3b0163873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:50.537119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcac18b-9bb5-4b62-ab3e-6448ea354e61 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:50.638764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 142/273] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:50.641972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e794-dfe0-453b-b29c-9b7ccf96d1b6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:50.642836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e794-dfe0-453b-b29c-9b7ccf96d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:50.649833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e794-dfe0-453b-b29c-9b7ccf96d1b6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:50.654306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 143/274] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:50.663128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:50.664366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:50.665178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:50.720378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:50.736657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcac18b-9bb5-4b62-ab3e-6448ea354e61 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:50.738199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:50.742126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:50.812110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:50.813449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:50.814060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:50.815780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:50.818298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:50.821152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:50.826015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 132/275] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:50.834789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:50.851788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:50.887979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 144/276] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:51.030236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675675c-6a62-40bb-a031-df30fe875a5e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:51.156957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:51.157597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.157883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.158132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.158863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:51.160357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:51.163429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:51.176794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:51.201069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 133/277] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:06:50 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:51.269951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:51.374498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6face-0309-43a3-80a5-887ba4d2aadf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:51.441601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51830cbb-b8c3-4371-8882-ab4bfd848445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:51.442638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51830cbb-b8c3-4371-8882-ab4bfd848445 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.443093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51830cbb-b8c3-4371-8882-ab4bfd848445 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.443443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51830cbb-b8c3-4371-8882-ab4bfd848445 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.460602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8459b-f95e-44df-857c-ea1df82ee387 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:51.462942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51830cbb-b8c3-4371-8882-ab4bfd848445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-51830cbb-b8c3-4371-8882-ab4bfd848445 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:51.471301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:51.473159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:51.474837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 145/278] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:51.477212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174bc3-7546-4147-a7dd-4981e0d01867 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.477212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174bc3-7546-4147-a7dd-4981e0d01867 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.477212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174bc3-7546-4147-a7dd-4981e0d01867 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.479588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 146/279] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:51.487608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174bc3-7546-4147-a7dd-4981e0d01867 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:51.534888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c0d04-3472-4f38-881e-637466524456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:51.536542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c0d04-3472-4f38-881e-637466524456 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.537355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c0d04-3472-4f38-881e-637466524456 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.538105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c0d04-3472-4f38-881e-637466524456 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.563181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c0d04-3472-4f38-881e-637466524456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:51.563907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fe7c0d04-3472-4f38-881e-637466524456 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:51.574374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:51.575838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:51.577229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 134/280] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:51.579184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.581638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.581638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.609397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:51.611138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:51.688316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174bc3-7546-4147-a7dd-4981e0d01867 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:51.700420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:51.719962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 135/281] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:51.720939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:51.762294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:51.765202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.765910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.766585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.768141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:51.768666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:51.772468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:51.798780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 147/282] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:51.805846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:51.906109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1f14-a242-4b7c-ad9d-07012de62040 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:51.982453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:51.982987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:51.983266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:51.983520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:51.984290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:51.984602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:51.986089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:52.007925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 136/283] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:52.017822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:52.045933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316425-0b64-43f4-877c-f160f7b537c7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:52.051828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:52.141391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:52.159625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:52.160696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:52.161161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:52.161625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] PATH_INFO: `/v3/users/af5a015987c7492193c9061c3aa28fa0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:52.202595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] RBAC: Authorizing `identity:get_user(user_id=af5a015987c7492193c9061c3aa28fa0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:52.205508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:52.208903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 148/284] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:51 2022] GET /identity/v3/users/af5a015987c7492193c9061c3aa28fa0 => generated 293 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:52.225252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:52.264437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7249e-384f-40a1-8ca2-17443ecb686a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:52.338321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:52.339429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:52.339928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:52.340661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] PATH_INFO: `/v3/users/389eb93187424c41b160617515f83588` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:52.343014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] RBAC: Authorizing `identity:get_user(user_id=389eb93187424c41b160617515f83588)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:52.346197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:52.350068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 137/285] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:52 2022] GET /identity/v3/users/389eb93187424c41b160617515f83588 => generated 297 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:52.358267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:52.450067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6df99-6eb7-4e70-8995-8f3e9f50c6cb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:52.500896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:52.501495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:52.502836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:52.503108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:52.503888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, user.id=af5a015987c7492193c9061c3aa28fa0, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:52.504193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:52.505728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:52.517028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 149/286] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 1 05:06:52 2022] GET /identity/v3/role_assignments?user.id=af5a015987c7492193c9061c3aa28fa0&scope.system=all&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:52.518673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:52.609459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:52.624047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7abac-901f-4217-970d-dfbc3eb35983 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:52.686439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:52.692226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e55e5e-6727-49d0-bdf5-5d328aa35578 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:52.739228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:52.739894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:52.740178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:52.740431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:52.742206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:52.743770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:52.746055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 150/287] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:52 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:52.756048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:52.768219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:52.769214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:52.769706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:52.770189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:52.799692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:52.809287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:52.812050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:52.814277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 138/288] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:52.831204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:53.026706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025146c-ebc6-4185-8d28-d964aa928829 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:53.090340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:53.104962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388877-6377-4456-afe3-88ae24405de6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:53.145138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:53.146426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:53.146848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:53.147269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:53.148401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:53.148954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:53.151740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:53.180756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:53.181800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:53.182214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:53.182618 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/389eb93187424c41b160617515f83588/roles/d02cc34f367b408fa485c7db59f0763b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:53.182929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 139/289] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:53.192556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] RBAC: Authorizing `identity:create_grant(project_id=41167c2035b74c5ca9df5ba5e1c86757, user_id=389eb93187424c41b160617515f83588, role_id=d02cc34f367b408fa485c7db59f0763b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:53.195509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:53.203996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:53.236362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 151/290] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:06:52 2022] PUT /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/users/389eb93187424c41b160617515f83588/roles/d02cc34f367b408fa485c7db59f0763b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:53.312057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:53.432786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224754-9827-4095-9d5b-a1b84ba3d28c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:53.497518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:53.498910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:53.499300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:53.500032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] PATH_INFO: `/v3/users/dad4be00e91e4f27a0bf3c1eed85f1af` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:53.502094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] RBAC: Authorizing `identity:get_user(user_id=dad4be00e91e4f27a0bf3c1eed85f1af)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:53.504719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:53.512345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 140/291] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:53 2022] GET /identity/v3/users/dad4be00e91e4f27a0bf3c1eed85f1af => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:53.518540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:53.681506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e782-8a7c-4109-8305-791f59b18a67 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:53.725306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:53.725938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:53.726210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:53.726472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:53.757943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:53.820598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:53.822139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:53.961552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 152/292] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:53.967454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:54.113577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e58d-d5fd-4a4d-bdbc-236054dba315 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:54.127503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:54.180006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d4e08-82a5-4857-a38f-cc8e583d1263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:54.181094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4e08-82a5-4857-a38f-cc8e583d1263 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:54.181556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4e08-82a5-4857-a38f-cc8e583d1263 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:54.182004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4e08-82a5-4857-a38f-cc8e583d1263 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:54.184006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d4e08-82a5-4857-a38f-cc8e583d1263 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:54.186379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d4e08-82a5-4857-a38f-cc8e583d1263 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:54.194338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 141/293] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:53 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:54.200267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:54.321974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:54.330728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f98d8-3837-4b6b-ae01-be68771b7c9a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:54.331248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f98d8-3837-4b6b-ae01-be68771b7c9a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:54.331719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f98d8-3837-4b6b-ae01-be68771b7c9a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:54.334226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 142/294] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:54.341570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06487018-de3d-4602-88cc-bb013f630224 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:54.342036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06487018-de3d-4602-88cc-bb013f630224 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:54.342485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06487018-de3d-4602-88cc-bb013f630224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:54.380313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-06487018-de3d-4602-88cc-bb013f630224 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:54.382507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-06487018-de3d-4602-88cc-bb013f630224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:54.454309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e917d-608d-4c04-b0d2-b1e7e945320b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:54.530315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 143/295] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:54.540425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:54.541098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:54.541376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:54.541652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:54.542408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=dad4be00e91e4f27a0bf3c1eed85f1af) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:54.542720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:54.544205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a6721-bf02-4401-bb09-60077c5095f8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:54.551914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 153/296] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:54 2022] GET /identity/v3/role_assignments?user.id=dad4be00e91e4f27a0bf3c1eed85f1af&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:54.842928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06487018-de3d-4602-88cc-bb013f630224 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:55.024031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06487018-de3d-4602-88cc-bb013f630224 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:55.029071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:55.062759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ed57-0e8c-470c-80d4-91f7957299eb None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:55.063745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ed57-0e8c-470c-80d4-91f7957299eb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:55.064488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ed57-0e8c-470c-80d4-91f7957299eb None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:55.072477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 154/297] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:55.081485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a2b9-b21b-4987-8b92-fdc7c3b9fe4f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:55.082962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a2b9-b21b-4987-8b92-fdc7c3b9fe4f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:55.083776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a2b9-b21b-4987-8b92-fdc7c3b9fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:55.118136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:55.119692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:55.120510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:55.121284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:55.126954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:55.131904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:55.133351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f997a2b9-b21b-4987-8b92-fdc7c3b9fe4f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:55.134726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 144/298] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:55.136092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f997a2b9-b21b-4987-8b92-fdc7c3b9fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:55.141351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:55.303796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 155/299] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:55.357860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b3aec-3f48-47e5-b345-9ff499330629 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:55.415109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f732d-aa9c-4b3f-9b13-abac707b5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:55.416086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f732d-aa9c-4b3f-9b13-abac707b5ec1 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:55.416560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f732d-aa9c-4b3f-9b13-abac707b5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:55.417053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f732d-aa9c-4b3f-9b13-abac707b5ec1 None admin] PATH_INFO: `/v3/groups` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:55.417993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f732d-aa9c-4b3f-9b13-abac707b5ec1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:55.419779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f732d-aa9c-4b3f-9b13-abac707b5ec1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:55.444485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 145/300] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Sep 1 05:06:55 2022] POST /identity/v3/groups => generated 229 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:55.535646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c917-f9d1-4900-a2f6-9673c9d70c67 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:55.536359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c917-f9d1-4900-a2f6-9673c9d70c67 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:55.536931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c917-f9d1-4900-a2f6-9673c9d70c67 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:55.539287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 156/301] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:55.546885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:55.547548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:55.548027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:55.571330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:55.573204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:55.608970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:55.669122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 146/302] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:55.798587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644c917-f9d1-4900-a2f6-9673c9d70c67 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:55.896817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:55.972941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644c917-f9d1-4900-a2f6-9673c9d70c67 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.012595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:56.014229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.014883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.015191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.015489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.028000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:56.038426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:56.039357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:06:56.040344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 157/303] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:06:56.049749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:56.193813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebcdb5-6ab3-4a3f-be7e-ef9ee2931592 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.256040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff94e3-bb28-464a-b80d-560845ab5170 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.260113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.261183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.261621 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.262066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.277538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:56.283907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:56.293483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:56.295521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:06:56.297968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:56.302798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 147/304] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:56.310059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:56.333631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.336134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.337053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.337761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.339548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:56.340339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:56.344153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:56.358019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:56.369782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 158/305] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:56.371225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:56.510551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75d3aa-0070-47fb-9cce-e4b7bca43807 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.573946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.575012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.575504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.575948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.577308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:56.578015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:56.580685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:56.587053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7051a-9711-4da5-a0f2-4a69742bb1ab None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.602273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 148/306] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:56.605599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:56.646619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbeb521-42cc-4341-9cea-e3efde005b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.647775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb521-42cc-4341-9cea-e3efde005b4d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.648290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb521-42cc-4341-9cea-e3efde005b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.648786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb521-42cc-4341-9cea-e3efde005b4d None admin] PATH_INFO: `/v3/users/2842682448524c32917ce96b9c5e4d60` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.667632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeb521-42cc-4341-9cea-e3efde005b4d None admin] RBAC: Authorizing `identity:get_user(user_id=2842682448524c32917ce96b9c5e4d60)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:56.669482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbeb521-42cc-4341-9cea-e3efde005b4d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:56.676666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 159/307] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:56 2022] GET /identity/v3/users/2842682448524c32917ce96b9c5e4d60 => generated 293 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:56.676893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278f1e6-1baf-4634-a155-e5f3dd61dbcc None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.677297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278f1e6-1baf-4634-a155-e5f3dd61dbcc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.677749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278f1e6-1baf-4634-a155-e5f3dd61dbcc None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.681133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 160/308] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:56.683744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278f1e6-1baf-4634-a155-e5f3dd61dbcc None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:56.740884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:56.745461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:56.772068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959baf65-ec61-4741-857c-e4753cf4a087 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.844236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7a9a-1e3c-4d3c-acef-5ba7b3435005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.845252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7a9a-1e3c-4d3c-acef-5ba7b3435005 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.845687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7a9a-1e3c-4d3c-acef-5ba7b3435005 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.846156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7a9a-1e3c-4d3c-acef-5ba7b3435005 None admin] PATH_INFO: `/v3/users/af5a015987c7492193c9061c3aa28fa0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.848321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7a9a-1e3c-4d3c-acef-5ba7b3435005 None admin] RBAC: Authorizing `identity:get_user(user_id=af5a015987c7492193c9061c3aa28fa0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:56.850916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7a9a-1e3c-4d3c-acef-5ba7b3435005 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:56.858815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 149/309] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:56 2022] GET /identity/v3/users/af5a015987c7492193c9061c3aa28fa0 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:56.858815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.858815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.858815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.871334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278f1e6-1baf-4634-a155-e5f3dd61dbcc None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:56.884707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:56.886343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:56.935214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:56.936158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:56.936503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:56.937098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:56.938126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] RBAC: Adding query filter params (role.id=d02cc34f367b408fa485c7db59f0763b, user.id=2842682448524c32917ce96b9c5e4d60, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:56.938633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:56.941169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:56.960668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 161/310] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 1 05:06:56 2022] GET /identity/v3/role_assignments?user.id=2842682448524c32917ce96b9c5e4d60&scope.system=all&role.id=d02cc34f367b408fa485c7db59f0763b => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:56.960668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:57.009708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 150/311] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:57.142820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:57.161795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f54c-06f2-4b23-9e24-b2eb4691545d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:57.225566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:57.226672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:57.227138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:57.227592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] PATH_INFO: `/v3/system/users/af5a015987c7492193c9061c3aa28fa0/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:57.230405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af5a015987c7492193c9061c3aa28fa0, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:57.233013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:57.252564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 162/312] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Sep 1 05:06:56 2022] PUT /identity/v3/system/users/af5a015987c7492193c9061c3aa28fa0/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:57.320578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:57.424853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:57.447480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b7641-9ca8-4dd0-90ca-ff855e5cbedb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:57.490769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2215bd3-7d59-4386-8ce7-88b55397aa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:57.491817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2215bd3-7d59-4386-8ce7-88b55397aa34 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:57.492318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2215bd3-7d59-4386-8ce7-88b55397aa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:57.492837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2215bd3-7d59-4386-8ce7-88b55397aa34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:57.505937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2215bd3-7d59-4386-8ce7-88b55397aa34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e2215bd3-7d59-4386-8ce7-88b55397aa34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:06:57.511714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:06:57.512724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:06:57.513566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:06:57.516694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 151/313] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:06:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:06:57.521880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:57.737297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df863-7724-4ae1-ab64-528eca66b541 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:57.771346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bb1d8-0c10-49a8-934c-3ca924844a63 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:57.771766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bb1d8-0c10-49a8-934c-3ca924844a63 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:57.772171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bb1d8-0c10-49a8-934c-3ca924844a63 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:57.774654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 152/314] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:06:57.783033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:57.783755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:57.784223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:57.796775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:57.798555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:57.799030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:57.799488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:57.800373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:57.800925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:57.802591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:57.813676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 163/315] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:06:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:57.821860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:57.823571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:57.824839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:57.849853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:57.956120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719a6dc-4de0-4c3a-99e6-cd8e9b631a4c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:57.984212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 153/316] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:06:57.996980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:57.997877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:57.998321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:57.998732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] PATH_INFO: `/v3/users/389eb93187424c41b160617515f83588` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:58.000443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] RBAC: Authorizing `identity:get_user(user_id=389eb93187424c41b160617515f83588)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:58.002382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:58.004643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 164/317] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:06:57 2022] GET /identity/v3/users/389eb93187424c41b160617515f83588 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:58.016653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:58.165033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:58.224344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724217-b4c4-49d5-a83a-474a9159de40 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:58.284565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:58.293101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:58.294210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:58.294948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:58.295366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:58.391913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:58.411271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d6fbd-b1e9-4a2f-8479-a3096d9a3a8e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:58.432515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:58.434407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:58.452582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:58.453848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:58.454221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:58.454483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:58.455779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:58.457442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:58.459535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 165/318] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:58.467827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:58.570863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:58.635686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b106b9-be00-49f2-b891-43fde0e9ed30 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:58.637224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 154/319] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:58.640981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:58.684557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:58.686231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:58.686974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:58.687598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] PATH_INFO: `/v3/groups` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:58.688566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:58.691123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:58.724760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 166/320] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Sep 1 05:06:58 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:06:58.834716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1abb5-ad78-4f84-9922-eec4162dc0f2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:58.903238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcce4e-157d-4842-9449-45c0bba681c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:58.904799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcce4e-157d-4842-9449-45c0bba681c2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:58.905522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcce4e-157d-4842-9449-45c0bba681c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:58.906258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcce4e-157d-4842-9449-45c0bba681c2 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:58.908685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcce4e-157d-4842-9449-45c0bba681c2 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:58.911509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcce4e-157d-4842-9449-45c0bba681c2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:58.915266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 155/321] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:06:58 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:06:58.932882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:58.960456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:59.123791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007852ec-deab-4ffe-9d25-b4629a7d29c3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:59.189559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:59.190592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:59.191009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:59.191467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:59.192784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] RBAC: Adding query filter params (role.id=d02cc34f367b408fa485c7db59f0763b, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757, user.id=389eb93187424c41b160617515f83588) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:59.193305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:59.195812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ee723-92ae-46a8-b3c5-dba3313b2ad4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:59.207359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 167/322] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:06:58 2022] GET /identity/v3/role_assignments?user.id=389eb93187424c41b160617515f83588&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=d02cc34f367b408fa485c7db59f0763b => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:59.520144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd154a9-8f3c-4ce2-9258-6977ba2f413e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:59.521102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd154a9-8f3c-4ce2-9258-6977ba2f413e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:59.521102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd154a9-8f3c-4ce2-9258-6977ba2f413e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:59.522315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 156/323] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:59.528964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:59.529256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:59.529573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:59.547671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad996c9-dba1-4a05-9bdb-98ac5841e9d8 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:59.547928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad996c9-dba1-4a05-9bdb-98ac5841e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:59.548218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad996c9-dba1-4a05-9bdb-98ac5841e9d8 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:59.549855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 157/324] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:59.554052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:59.555686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:59.555986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:59.556154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:59.556313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:59.593604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:59.595499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:59.687342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:59.701295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 168/325] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:59.756234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 158/326] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:00.051508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:00.064226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:00.169142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:00.196374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d17c2-91aa-4890-ac11-26da6bb612ed None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:00.233080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:00.233770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:00.234039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:00.234422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:00.250725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:00.255368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:00.257154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:00.258753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 169/327] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:00.266200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:00.353268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:00.397383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327a7e-2449-47d1-b66e-c79db5b64606 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:00.467142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af8fa2-6175-4716-88af-e32edb84fa9c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:00.475800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:00.477169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:00.477837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:00.478493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:00.479859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:00.480589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:00.483362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:00.501660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 170/328] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:00.510362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:00.518478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:00.519211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:00.519495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:00.519764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:00.548389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:00.559774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:00.561522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:07:00.564024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:00.569108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 159/329] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:00.579653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:00.703476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:00.775819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78218306-669d-4906-b2a0-e49bae22a598 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:00.884053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:00.916338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b0b0-60b7-4c31-8484-1aafa0e97cd3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:00.927080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:00.928159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:00.928641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:00.929103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] PATH_INFO: `/v3/users/af5a015987c7492193c9061c3aa28fa0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:00.931377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] RBAC: Authorizing `identity:get_user(user_id=af5a015987c7492193c9061c3aa28fa0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:00.934204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:00.937379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 171/330] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:07:00 2022] GET /identity/v3/users/af5a015987c7492193c9061c3aa28fa0 => generated 293 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:00.954548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:01.015024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:01.016036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:01.016452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:01.017362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:01.018513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:01.019023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:01.024520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:01.060034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 160/331] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:01.067466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:01.235948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:01.252009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a333-efb3-4a5e-9650-238124632718 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:01.309755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:01.311326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:01.312123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:01.312967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] PATH_INFO: `/v3/users/2842682448524c32917ce96b9c5e4d60` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:01.318141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] RBAC: Authorizing `identity:get_user(user_id=2842682448524c32917ce96b9c5e4d60)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:01.321795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:01.327195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 161/332] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:07:01 2022] GET /identity/v3/users/2842682448524c32917ce96b9c5e4d60 => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:01.337031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:01.337311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9192e9-fccc-4cfc-9f44-4e49ba9a350d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:01.445602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:01.448680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:01.449781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:01.452727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:01.456736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] RBAC: Adding query filter params (role.id=05dc7b23426a4cc49791c2e6585774ad, user.id=af5a015987c7492193c9061c3aa28fa0, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:01.457689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:01.461994 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c61b9-3a4d-4a8b-9451-48170e0dfcf6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:01.506223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 172/333] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 1 05:07:00 2022] GET /identity/v3/role_assignments?user.id=af5a015987c7492193c9061c3aa28fa0&scope.system=all&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 510 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:01.647695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648064-ba13-4d34-8790-c928a2ac77b4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:01.727592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9b648-23ce-413f-91ba-86519890c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:01.729302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9b648-23ce-413f-91ba-86519890c911 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:01.730096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9b648-23ce-413f-91ba-86519890c911 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:01.730897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9b648-23ce-413f-91ba-86519890c911 None admin] PATH_INFO: `/v3/system/users/2842682448524c32917ce96b9c5e4d60/roles/d02cc34f367b408fa485c7db59f0763b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:01.738107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9b648-23ce-413f-91ba-86519890c911 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2842682448524c32917ce96b9c5e4d60, role_id=d02cc34f367b408fa485c7db59f0763b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:01.741350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9b648-23ce-413f-91ba-86519890c911 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:01.765953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 162/334] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Sep 1 05:07:01 2022] PUT /identity/v3/system/users/2842682448524c32917ce96b9c5e4d60/roles/d02cc34f367b408fa485c7db59f0763b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:07:02.637035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a23fc-f99a-498b-804f-af9b8c9f2657 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:02.638089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a23fc-f99a-498b-804f-af9b8c9f2657 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:02.638597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a23fc-f99a-498b-804f-af9b8c9f2657 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:02.640591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 173/335] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:02.646928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4def-f2b2-4445-97dd-37aecce685b7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:02.647573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4def-f2b2-4445-97dd-37aecce685b7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:02.648051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a4def-f2b2-4445-97dd-37aecce685b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:02.673851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2e4a4def-f2b2-4445-97dd-37aecce685b7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:02.675475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2e4a4def-f2b2-4445-97dd-37aecce685b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:02.697533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:02.778342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 163/336] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:03.117931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ce9a3-f2a6-405a-9b1a-f35f171a022f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:03.118309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ce9a3-f2a6-405a-9b1a-f35f171a022f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:03.118473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ce9a3-f2a6-405a-9b1a-f35f171a022f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:03.120282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 174/337] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:03.126547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:03.126865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:03.127098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:03.152556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:03.153817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:03.239827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 164/338] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:03.792062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ce9a3-f2a6-405a-9b1a-f35f171a022f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:03.825556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:03.955945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:04.021661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:04.084316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed818f94-9528-4325-8499-02dfd8998b35 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:04.086435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ce9a3-f2a6-405a-9b1a-f35f171a022f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:04.176160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:04.176880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:04.177150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:04.177418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:04.193105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:04.193775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:04.194050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:04.194321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:04.210574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:04.221822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:04.226313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:04.227276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:04.228103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:04.228756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:04.229614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:04.230436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:04.232700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 175/340] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:04.232878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 165/340] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:04.244145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:04.244571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:04.408112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef06e-ae2d-4376-87bb-4ca53c4a7140 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:04.480831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:04.482063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:04.482561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:04.483034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:04.484872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:04.485409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:04.488232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cea52-4d10-4260-9a10-0cefb0988fb5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:04.524861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 166/341] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:04.524861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecc3b-94cc-4571-85a5-e3713722e9bc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:04.524861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecc3b-94cc-4571-85a5-e3713722e9bc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:04.524861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecc3b-94cc-4571-85a5-e3713722e9bc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:04.527029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 167/342] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:04.538089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120b07a-9d71-4441-85d4-9c70939bcffa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:04.543249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:04.543733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:04.544211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:04.563968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:04.581727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:04.598279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:04.600349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:04.641247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:04.641994 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:04.642349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:04.642618 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:04.643308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:04.645856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:04.645856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:04.673506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 176/343] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:04.677264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:04.796092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 168/344] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:04.799768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:04.991256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0840-24be-455d-aaae-074311e26e5b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:05.047197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:05.048154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.052021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.052180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d73a2a-8cda-4e98-b443-da18c4831b6a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:05.053148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.103702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:05.104694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.105151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.105596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.110389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:05.174402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:05.218089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:05.219936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:05.237674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:05.239329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:05.353972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 177/345] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:05.359983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:05.481623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 169/346] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:05.482609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:05.536481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:05.543650 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:05.594815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ea6d4-b337-4f96-9a8c-433b8c974011 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:05.643520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906c11-9cc8-4298-b14a-c6c68d855622 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:05.651660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ee999-076e-47b5-90b2-70236fcc507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:05.652606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ee999-076e-47b5-90b2-70236fcc507c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.652922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ee999-076e-47b5-90b2-70236fcc507c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.653865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ee999-076e-47b5-90b2-70236fcc507c None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.655345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ee999-076e-47b5-90b2-70236fcc507c None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:05.658531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ee999-076e-47b5-90b2-70236fcc507c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:05.661548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 178/347] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:05 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:05.665756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828491f-6a80-4b9a-be3a-4925e81f6eb2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.666364 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828491f-6a80-4b9a-be3a-4925e81f6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.667284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828491f-6a80-4b9a-be3a-4925e81f6eb2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.669943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 179/348] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:05.672572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03156-b5fc-4a07-baac-15d43c0b0ce5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.673154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03156-b5fc-4a07-baac-15d43c0b0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.673601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03156-b5fc-4a07-baac-15d43c0b0ce5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.677272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 180/349] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:05.678820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03156-b5fc-4a07-baac-15d43c0b0ce5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:05.696186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:05.698271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.698681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.698987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.713834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:05.718243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:05.719948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 170/350] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:05.722435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:05.852441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03156-b5fc-4a07-baac-15d43c0b0ce5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:05.879242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:05.893380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ead36-1fbb-43ea-a57f-8ffe344cf9b0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:05.902245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea61ee-aa6b-4f5a-b91d-9a94f7dc6c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:05.902436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea61ee-aa6b-4f5a-b91d-9a94f7dc6c46 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.902682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea61ee-aa6b-4f5a-b91d-9a94f7dc6c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.902924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea61ee-aa6b-4f5a-b91d-9a94f7dc6c46 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.904556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea61ee-aa6b-4f5a-b91d-9a94f7dc6c46 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:05.906356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea61ee-aa6b-4f5a-b91d-9a94f7dc6c46 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:05.908141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 181/351] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:05 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:05.909649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.909926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.910196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.930759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:05.932020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:05.947349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:05.959910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf07f8-8124-4076-b5e3-ddf5cee4559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:05.961032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf07f8-8124-4076-b5e3-ddf5cee4559a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.961518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf07f8-8124-4076-b5e3-ddf5cee4559a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.961989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf07f8-8124-4076-b5e3-ddf5cee4559a None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:05.974660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf07f8-8124-4076-b5e3-ddf5cee4559a None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:05.979460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf07f8-8124-4076-b5e3-ddf5cee4559a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:05.980163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 171/352] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:05 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:05.985586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8e5ea-a49b-4588-852a-af19038e06e3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:05.985586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8e5ea-a49b-4588-852a-af19038e06e3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:05.985586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8e5ea-a49b-4588-852a-af19038e06e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.012751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-27d8e5ea-a49b-4588-852a-af19038e06e3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:06.014834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-27d8e5ea-a49b-4588-852a-af19038e06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:06.036482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 182/353] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:06.037317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:06.136357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 172/354] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:06.139200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d183-91ef-49c9-bfdc-5e5888104959 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.139200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d183-91ef-49c9-bfdc-5e5888104959 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.139200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d183-91ef-49c9-bfdc-5e5888104959 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.142020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 173/355] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:06.142950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d183-91ef-49c9-bfdc-5e5888104959 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:06.182853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e83ca-f77b-479f-971f-b26e9cf24c75 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:06.222938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:06.223571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.223848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.224134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.224860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:06.225167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:06.226658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:06.236861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 183/356] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:06.237511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:06.252972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:06.279761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:06.293484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d183-91ef-49c9-bfdc-5e5888104959 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:06.346577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5095c-e4e4-425e-97bf-74ef485f58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:06.347722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5095c-e4e4-425e-97bf-74ef485f58de None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.348585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5095c-e4e4-425e-97bf-74ef485f58de None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.348971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5095c-e4e4-425e-97bf-74ef485f58de None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.351103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5095c-e4e4-425e-97bf-74ef485f58de None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:06.352965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5095c-e4e4-425e-97bf-74ef485f58de None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:06.360725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 174/357] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:06 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:06.360725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.360725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.360725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.385536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:06.386787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:06.406913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92810-41b1-4079-9b5d-4be8f3013d3a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:06.462164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:06.462712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.463055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.463326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.464078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=892640f70c834da6a9715633f0fbc7ae) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:06.464446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:06.466235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:06.474778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 184/358] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:06 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:06.475723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:06.492779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 175/359] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:06.494440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:06.598600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:06.660670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a1e8f-37a2-4953-b768-6d0721d6b578 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:06.703301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:06.734561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa19ae-ab39-43d2-b717-49f3e07fa8d5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:06.744503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:06.745699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.746189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.746652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.827296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:06.828300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:06.828982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:06.829413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:06.830757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=892640f70c834da6a9715633f0fbc7ae) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:06.831214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:06.833571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:06.841249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 176/360] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:06 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 260 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:06.842125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:06.885702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:06.888416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:07.021816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b907fb-2c7c-4fd3-ac48-c07f5d8fab7f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:07.024146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:07.061314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 185/361] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:07.064063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.098402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:07.099498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:07.100018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:07.101347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:07.130315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:07.142568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:07.151662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 177/362] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:07.153198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.183403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:07.227809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6587563-db32-417c-bc73-6526d2d2f592 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:07.284999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:07.285735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:07.286059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:07.286372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:07.311292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:07.322132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:07.323137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:07.323964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:07.324794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 186/363] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:07.328752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.361225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099a60b-ec17-4839-90f9-a269793c1233 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:07.380296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:07.433933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:07.434871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:07.435342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:07.435799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:07.457141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:07.462822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354cbc5-0221-488e-9128-fb1a266f3f6e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:07.469652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:07.470677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:07:07.471492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:07.476803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 178/364] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:07.476803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.532461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:07.533547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:07.534041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:07.534528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:07.536501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:07.538121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:07.540782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 187/365] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:07.543505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.646308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:07.710795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5000de-8b6c-422b-8810-783be9ee6634 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:07.719662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac323e65-e9ce-4037-8e1c-f5bcb39a7886 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:07.721181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:07.774632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:07.775263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:07.775544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:07.775833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:07.776834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:07.776834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:07.778332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:07.792776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 179/366] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:07.792776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.798822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:07.799460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:07.799731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:07.799996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:07.800703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:07.801010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:07.803712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:07.824736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 188/367] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:07.826918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:07.996328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9bb7-94d8-4fd0-9bdb-87139aff64e7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:08.041191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:08.042026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:08.042466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:08.043462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:08.045131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:08.045700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:08.047364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:08.050556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:08.063305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 180/368] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:08.064688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:08.077346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b52dc-d5ff-4f96-b7aa-db5725b903dc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:08.144539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:08.145941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:08.146411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:08.146854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:08.149035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:08.151193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:08.153564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 189/369] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:07 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:08.154676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:08.205554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:08.248254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106aaad-68e3-44fb-96c6-ca588fe29c4c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:08.295643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:08.296905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:08.297372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:08.297792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:08.339648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c43262-3197-45f1-8139-45a7676581d3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:08.382583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:08.383580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:08.384391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:08.385475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:08.434820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:08.463416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:08.463748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:08.490368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:08.493419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:08.564142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:08.697470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 181/370] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:08.698749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:08.751661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 190/371] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:08.753462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:08.925850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:08.932262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2f76-0f27-4db3-b11f-91d218056ab2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:08.986280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:08.987060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:08.987446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:08.987782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] PATH_INFO: `/v3/users/2842682448524c32917ce96b9c5e4d60` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:08.989326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] RBAC: Authorizing `identity:get_user(user_id=2842682448524c32917ce96b9c5e4d60)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:08.990945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.000786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 182/372] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:07:08 2022] GET /identity/v3/users/2842682448524c32917ce96b9c5e4d60 => generated 293 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.000786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.019917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7871bd-9bf9-4c1c-8038-d57c190c8d77 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.054373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:09.065457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.066440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.066889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.067330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.068253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:09.068789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.070461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.078026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 191/373] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:08 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 260 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.079969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.211235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b276e-cf96-4923-bd5d-429737422bf6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.255406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.255659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d7026-0301-4ccb-9651-5ca57f610914 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.257114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.257670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.258141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] PATH_INFO: `/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.260087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c21f4c2bbfcf4e0f8ddce568cdfb4031)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.261947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.264512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 192/374] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:09 2022] GET /identity/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.266187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.332753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.333760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.334738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.335022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.337186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.339907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.343476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 183/375] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:08 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.345356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:09.349965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.399315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fed1b-09d0-4648-bb3a-ee07599730f8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.413140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:09.443109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.444204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.444753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.445289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.446279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] RBAC: Adding query filter params (role.id=d02cc34f367b408fa485c7db59f0763b, user.id=2842682448524c32917ce96b9c5e4d60, scope.system=all) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:09.446807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.448538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.468953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 193/376] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Sep 1 05:07:09 2022] GET /identity/v3/role_assignments?user.id=2842682448524c32917ce96b9c5e4d60&scope.system=all&role.id=d02cc34f367b408fa485c7db59f0763b => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.470379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.560583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e3c1-82eb-4bd5-bdfe-f27da4cbf6c9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.634749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.636098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.636580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.637068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] PATH_INFO: `/v3/groups/f06a3c16c90d41aebb48492216c16836` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.655353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] RBAC: Authorizing `identity:get_group(group_id=f06a3c16c90d41aebb48492216c16836)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.656880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d9d5-ad9d-42f4-bb2b-39278cb7f8dc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.658140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.661640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 184/377] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:09 2022] GET /identity/v3/groups/f06a3c16c90d41aebb48492216c16836 => generated 229 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.670391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.680144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:09.703933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.705095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.705620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.706103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.707788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.709590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:09.711601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 194/378] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:09 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:09.718572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:09.927223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:09.941882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd8f9a-e3f6-42d4-8958-00c69d23b531 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.985788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab370-1aa4-4134-80d7-236238605234 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:09.993653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:09.994308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:09.995907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:09.995907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:09.995907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] RBAC: Adding query filter params (group.id=f06a3c16c90d41aebb48492216c16836, role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=c21f4c2bbfcf4e0f8ddce568cdfb4031) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:09.995907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:09.997466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744865d2-d47b-4108-a0f6-26230e0cadc3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:10.004951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 185/379] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:09 2022] GET /identity/v3/role_assignments?group.id=f06a3c16c90d41aebb48492216c16836&scope.project.id=c21f4c2bbfcf4e0f8ddce568cdfb4031&role.id=73d94b00a1864422b65efc55999d79b0 => generated 260 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:10.006317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a005-54aa-43b6-b416-7c84ebd58a27 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:10.006608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a005-54aa-43b6-b416-7c84ebd58a27 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:10.006882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a005-54aa-43b6-b416-7c84ebd58a27 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:10.008646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 186/380] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:10.015750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:10.017385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:10.018226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:10.063566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:10.066578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:10.116439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:10.117285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:10.117417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:10.117797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:10.118393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:10.118702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:10.120198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433b7bd-6ff8-4b9e-b8dd-7e12e5922dca None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:10.141098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 195/381] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:09 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 260 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:10.153247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6dfb5-e420-40a2-9fa1-07e106fdde44 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:10.153499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6dfb5-e420-40a2-9fa1-07e106fdde44 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:10.153803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6dfb5-e420-40a2-9fa1-07e106fdde44 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:10.155691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 196/382] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:07:10.165180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:10.165495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:10.165787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:10.205666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:10.206850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:10.243121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 187/383] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:10.302218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:10.332537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 197/384] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:07:10.564168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:10.700210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:10.716350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2ba4f-96d3-42b3-bbbd-600821ca9f40 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:10.755663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:10.759510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:10.760513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:10.760991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:10.761444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:10.778516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:10.785856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:10.786864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:10.787700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:10.791027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 188/385] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:10.798565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:10.911496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828fce1-d608-47c5-bf8f-911e697742f0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.005297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.006309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.006748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.007151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.035701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959fa3f-77fe-4573-aaa3-3376c7951cf2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.052812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:11.068217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:11.069279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:11.070110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:11.071180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 198/386] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:11.079422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:11.116442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.117259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.117559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.117840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.118557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:11.118860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:11.120308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:11.144123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 189/387] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:11.148403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:11.180490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:11.200580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:11.351581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c47d2a-3e15-42ed-8ee1-9aeab9245b0b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.395961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d27d-b8ac-4820-a023-af12c2c00a43 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.441385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.441922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.442194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.442460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.443141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:11.443442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:11.447773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:11.471163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 199/388] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:11.476757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:11.493159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.493829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.494111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.494382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.498780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:11.502621 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:11.504590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 190/389] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:11 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:11.515765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:11.646991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:11.672421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340f92-49dd-4c85-a6d4-6060f9bfc277 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.715974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.716558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.716876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.717153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.718768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:11.720744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:11.723623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 191/390] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:11 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:11.729886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:11.748252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a18a4-e6b9-46b3-b038-5e42a776f543 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.750829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:11.855979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2c9ad-da00-4917-a874-79e0a6e45175 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:11.873425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.874686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.875419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.875905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.881477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:11.883315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:11.886002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 200/391] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:11 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:11.895917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:11.896649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:11.896927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:11.897205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae/groups/490e6f6b566b487fafc521a4016d96ff/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:11.898008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:11.899393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=892640f70c834da6a9715633f0fbc7ae, group_id=490e6f6b566b487fafc521a4016d96ff, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:11.901011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:11.925797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 192/392] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 1 05:07:11 2022] PUT /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae/groups/490e6f6b566b487fafc521a4016d96ff/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:12.042480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1df93f-7337-4cc8-b912-b7bae1dad13d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:12.092736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc27b-f8a7-4a63-9da3-af7710bf55ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:12.094069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc27b-f8a7-4a63-9da3-af7710bf55ed None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:12.094360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc27b-f8a7-4a63-9da3-af7710bf55ed None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:12.094632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc27b-f8a7-4a63-9da3-af7710bf55ed None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:12.095901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc27b-f8a7-4a63-9da3-af7710bf55ed None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:12.097469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc27b-f8a7-4a63-9da3-af7710bf55ed None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:12.099624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 201/393] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:11 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:12.105634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:12.121178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:12.178035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45ad5-147c-4e94-97a9-7e3fd345bf3a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:12.178396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45ad5-147c-4e94-97a9-7e3fd345bf3a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:12.178583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45ad5-147c-4e94-97a9-7e3fd345bf3a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:12.180325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 202/394] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:07:12.185922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:12.186238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:12.186596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:12.222071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:12.223382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:12.287366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2025da-4130-4e6e-8844-d8563cd24a34 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:12.316054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:12.336305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:12.338657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:12.339228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:12.339677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae/groups/490e6f6b566b487fafc521a4016d96ff/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:12.343535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] RBAC: Authorizing `identity:create_grant(project_id=892640f70c834da6a9715633f0fbc7ae, group_id=490e6f6b566b487fafc521a4016d96ff, role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:12.346339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:12.374346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 193/395] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 1 05:07:12 2022] PUT /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae/groups/490e6f6b566b487fafc521a4016d96ff/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:12.387391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 203/396] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:07:12.764871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:12.871604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:12.956660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da8d2-627c-4050-a277-e1fb819b6a26 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:13.055827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a0e12-264c-4028-8920-4a555da61dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:13.056906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a0e12-264c-4028-8920-4a555da61dfc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.057425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a0e12-264c-4028-8920-4a555da61dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.057921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a0e12-264c-4028-8920-4a555da61dfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.085519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a0e12-264c-4028-8920-4a555da61dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-362a0e12-264c-4028-8920-4a555da61dfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:13.097486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:13.099272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:13.101659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 194/397] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:13.113867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:13.233850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2efa8-dd50-4046-9623-befca34ba47f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.234352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2efa8-dd50-4046-9623-befca34ba47f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.234820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2efa8-dd50-4046-9623-befca34ba47f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.246221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 195/398] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:13 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:13.254473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc963c-5883-4861-8437-740feb67481f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.254737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc963c-5883-4861-8437-740feb67481f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.255048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc963c-5883-4861-8437-740feb67481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.278317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8373b-bbd4-4e12-8836-df4c8f6ed304 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:13.289600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-83cc963c-5883-4861-8437-740feb67481f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:13.292985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-83cc963c-5883-4861-8437-740feb67481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:13.319959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:13.320589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.320888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.321149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.321833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] RBAC: Adding query filter params (name=member) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:13.322130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:13.323563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3f6c-0c27-4385-9d8d-152bf2b4a609 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:13.338987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 204/399] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:13.340510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927e2d-88b6-48c4-a146-e6cf61a7e807 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.340831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927e2d-88b6-48c4-a146-e6cf61a7e807 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.341112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9927e2d-88b6-48c4-a146-e6cf61a7e807 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.343417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 205/400] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:13.344501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927e2d-88b6-48c4-a146-e6cf61a7e807 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:13.391891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:13.484767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 196/401] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:13.486300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.486585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.486858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.500018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9927e2d-88b6-48c4-a146-e6cf61a7e807 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:13.533689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:13.536260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:13.625796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:13.626855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:13.627323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:13.627808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:13.637467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:13.644614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:13.648113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 206/402] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:13 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:13.655870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:13.708408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:13.775439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 197/403] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:13.854898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:13.908365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:13.916021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a6bf-1742-4739-af4f-11581701b7f2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:14.003489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:14.005108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.005845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.006582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.009293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:14.012295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:14.016420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 207/404] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:13 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:14.031201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:14.042611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26edbe-fe82-4337-8126-146653b95da0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:14.083580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:14.084691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.085182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.085659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.099214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:14.104847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:14.105833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:14.106680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:14.110072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 198/405] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:14.115842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:14.280575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:14.339937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d47de2-fa03-457e-bae6-a3b98f0a2d04 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:14.405812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a5cd-0d79-4192-9fa4-0f349a9808d1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:14.406530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:14.407630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.408041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.408539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/groups/490e6f6b566b487fafc521a4016d96ff/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.412119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] RBAC: Authorizing `identity:create_grant(project_id=41167c2035b74c5ca9df5ba5e1c86757, group_id=490e6f6b566b487fafc521a4016d96ff, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:14.414992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:14.442763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 208/406] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 1 05:07:14 2022] PUT /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/groups/490e6f6b566b487fafc521a4016d96ff/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:14.444669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:14.500265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:14.501994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.502791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.503561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.505432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:14.506509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:14.507516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:14.511629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:14.557428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 199/407] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:14.565288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:14.743767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1ec19-92ed-4600-8942-d53eabd40317 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:14.808277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:14.809193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.810676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.810676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.837267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:14.847905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7316e7-56d3-4353-a285-63fa461e4c13 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:14.851602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:14.853158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:14.854430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 209/408] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:14.864121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:14.886374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:14.944733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d9d7-a366-4446-800d-c55c5ed0d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:14.946454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d9d7-a366-4446-800d-c55c5ed0d929 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.947323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d9d7-a366-4446-800d-c55c5ed0d929 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.948038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d9d7-a366-4446-800d-c55c5ed0d929 None admin] PATH_INFO: `/v3/groups/f06a3c16c90d41aebb48492216c16836` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.950601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143d9d7-a366-4446-800d-c55c5ed0d929 None admin] RBAC: Authorizing `identity:get_group(group_id=f06a3c16c90d41aebb48492216c16836)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:14.954066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143d9d7-a366-4446-800d-c55c5ed0d929 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:14.958312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 200/409] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:14 2022] GET /identity/v3/groups/f06a3c16c90d41aebb48492216c16836 => generated 229 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:14.961085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed232-1864-4b80-aad3-bd4d27727c59 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:14.961893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed232-1864-4b80-aad3-bd4d27727c59 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:14.962675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed232-1864-4b80-aad3-bd4d27727c59 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:14.965731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 201/410] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:14.967728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed232-1864-4b80-aad3-bd4d27727c59 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:14.992606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:15.010888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1698-b730-407c-9902-d9a692cfca7c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:15.050411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:15.051152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.051487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.051821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.052570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:15.052992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:15.054486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c96c-d357-47fb-a3b4-f86b0a5cbcae None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:15.064761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 210/411] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:15.066282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.066625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.066969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.087085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:15.088403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:15.167825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 211/412] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:15.168999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:15.194142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed232-1864-4b80-aad3-bd4d27727c59 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:15.263702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:15.265394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.267703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.268236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] PATH_INFO: `/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.273589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c21f4c2bbfcf4e0f8ddce568cdfb4031)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:15.276610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:15.280952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 202/413] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:14 2022] GET /identity/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031 => generated 344 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:15.287881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:15.329831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:15.355356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483325d6-9ece-4045-80df-013a3ad50410 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:15.396501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:15.397591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.398086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.398551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.400013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:15.401835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:15.404349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 212/414] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:15 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:15.426436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:15.435247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:15.559141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c591-925c-4d63-9816-c1225eef21e6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:15.632698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3622-e19c-4b27-a7b1-fb8102ff0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:15.633464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3622-e19c-4b27-a7b1-fb8102ff0ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.633749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3622-e19c-4b27-a7b1-fb8102ff0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.634359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3622-e19c-4b27-a7b1-fb8102ff0ef6 None admin] PATH_INFO: `/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031/groups/f06a3c16c90d41aebb48492216c16836/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.637303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3622-e19c-4b27-a7b1-fb8102ff0ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c21f4c2bbfcf4e0f8ddce568cdfb4031, group_id=f06a3c16c90d41aebb48492216c16836, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:15.638786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3622-e19c-4b27-a7b1-fb8102ff0ef6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:15.646165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319afc4-c255-46ec-8e61-d9f33508d2cc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:15.659547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 203/415] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 1 05:07:15 2022] PUT /identity/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031/groups/f06a3c16c90d41aebb48492216c16836/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:15.662624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e5771-726a-4dc0-8fea-8c6415b60d35 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.663370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e5771-726a-4dc0-8fea-8c6415b60d35 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.664098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e5771-726a-4dc0-8fea-8c6415b60d35 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.667561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 204/416] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:15.669381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e5771-726a-4dc0-8fea-8c6415b60d35 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:15.730350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31840b-679b-45b5-9e72-f6a63b0f3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:15.731548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31840b-679b-45b5-9e72-f6a63b0f3c34 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.732040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31840b-679b-45b5-9e72-f6a63b0f3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.732508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31840b-679b-45b5-9e72-f6a63b0f3c34 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.734998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31840b-679b-45b5-9e72-f6a63b0f3c34 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:15.737910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31840b-679b-45b5-9e72-f6a63b0f3c34 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:15.748840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 213/417] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:15 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:15.748840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:15.748840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:15.748840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:15.779282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:15.782003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:15.801996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:15.911375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 214/418] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:15.912145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:15.938021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e5771-726a-4dc0-8fea-8c6415b60d35 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:15.951179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:16.003866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:16.004585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:16.004905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:16.005182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:16.026098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:16.033417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:16.035278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:16.036911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:16.039803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 205/419] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:16.046025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:16.165711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa06c-ed6d-4bc2-9e6e-2021ef03ec1e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:16.250324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:16.251387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:16.251868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:16.252317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/groups/490e6f6b566b487fafc521a4016d96ff/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:16.254808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] RBAC: Authorizing `identity:create_grant(project_id=41167c2035b74c5ca9df5ba5e1c86757, group_id=490e6f6b566b487fafc521a4016d96ff, role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:16.256571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:16.288797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 215/420] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Sep 1 05:07:15 2022] PUT /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757/groups/490e6f6b566b487fafc521a4016d96ff/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:16.304975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367d2d-0223-499d-8df7-2dc3815341b3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:16.399142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:16.400239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:16.400889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:16.401392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:16.402831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:16.403327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:16.406447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:16.424748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 206/421] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:16.433325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:16.445287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:16.513500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:16.555643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:16.719846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aa690-11cf-4c7d-a96e-ed11e37d3846 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:16.733398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78efd08-0152-40b2-879f-67c47adfba5c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:16.817826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:16.818808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:16.819210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:16.819611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:16.849210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:16.850226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:16.850688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:16.851115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:16.858687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:16.876372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:16.877432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:16.878266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:16.882477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 207/422] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:16.888855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:17.050468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:17.072405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce2e9-45fe-488c-94eb-cbe239d9cbe9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:17.095133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:17.097966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:17.114613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:17.142639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:17.143528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:17.143923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:17.144302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:17.145350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:17.145786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:17.148151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:17.182161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 208/423] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:17.191969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:17.330226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7d54e-bcc9-4a7f-9c85-0e2cdc7c3ce2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:17.374900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:17.376982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:17.377292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:17.377537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:17.405292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:17.452011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 216/424] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1019 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:17.460005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:17.465009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:17.466649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:17.583272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 209/425] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:07:17.591748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:17.707936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:17.756992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bac4d-e705-48f9-9535-a002f56307a8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:17.766818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:17.783293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28c6f8-b474-4950-8c07-79404eb03740 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:17.818627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:17.819333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:17.819553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:17.819823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:17.828657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:17.828657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:17.828961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 217/426] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:17 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:17.831811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:17.837549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:17.838136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:17.838414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:17.838687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] PATH_INFO: `/v3/projects/892640f70c834da6a9715633f0fbc7ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:17.841880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] RBAC: Authorizing `identity:get_project(project_id=892640f70c834da6a9715633f0fbc7ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:17.844505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:17.848380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 210/427] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:17 2022] GET /identity/v3/projects/892640f70c834da6a9715633f0fbc7ae => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:17.858088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:18.010720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2470-319b-4e80-b2b3-c01998b8243e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:18.019388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c0b8e-62e4-40d0-a373-5d7ddfe36890 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:18.047740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.068793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1274f-cb80-4b62-adf2-b08bb8aee61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:18.070158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1274f-cb80-4b62-adf2-b08bb8aee61e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.070657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1274f-cb80-4b62-adf2-b08bb8aee61e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.071088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1274f-cb80-4b62-adf2-b08bb8aee61e None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.072844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1274f-cb80-4b62-adf2-b08bb8aee61e None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:18.074629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1274f-cb80-4b62-adf2-b08bb8aee61e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:18.076915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 211/428] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:17 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:18.079342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55702a-bb45-4931-9d0e-3f13b1a22535 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.079820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55702a-bb45-4931-9d0e-3f13b1a22535 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.080237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55702a-bb45-4931-9d0e-3f13b1a22535 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.082201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 212/429] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:18.090958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.090958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.090958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.092180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:18.093197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.093984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.094284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.095555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:18.097193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:18.099311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 218/430] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:17 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:18.100150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:18.130684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:18.134706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:18.157698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.237450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4e38d-ee7c-42c7-90cd-f9ea479e2e2f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:18.297670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 213/431] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:18.298884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:18.308098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:18.310515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.311416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.312938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.315615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=892640f70c834da6a9715633f0fbc7ae) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:18.316536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:18.321395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:18.347261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 219/432] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:18 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:18.477948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677d54f-4239-498e-9e53-eb9bcc21fad3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:18.519683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.576944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:18.577869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.578329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.578789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.580084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=892640f70c834da6a9715633f0fbc7ae) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:18.580610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:18.583211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:18.594041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:18.599451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 214/433] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:18 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=892640f70c834da6a9715633f0fbc7ae&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 611 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:18.754009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fce65e-adaa-4afb-b65d-9514da112a85 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:18.757158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.807398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff33091-375b-408d-beb5-f39448dfac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:18.808082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff33091-375b-408d-beb5-f39448dfac35 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:18.808368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff33091-375b-408d-beb5-f39448dfac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:18.808669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff33091-375b-408d-beb5-f39448dfac35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:18.823449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff33091-375b-408d-beb5-f39448dfac35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-eff33091-375b-408d-beb5-f39448dfac35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:18.829714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:18.831435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:18.833106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 220/434] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:18.844566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:19.047270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe4337-06f3-4e59-9764-aa75499018e1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:19.082687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e442-2452-4911-a7b2-94e83a51ad43 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.083136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e442-2452-4911-a7b2-94e83a51ad43 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.083601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e442-2452-4911-a7b2-94e83a51ad43 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.087366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 221/435] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:07:19.093567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c72ba4-f28a-4afd-ba35-e0bcedcdd145 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.093991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c72ba4-f28a-4afd-ba35-e0bcedcdd145 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.094792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c72ba4-f28a-4afd-ba35-e0bcedcdd145 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.096281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 222/436] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:19.097708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:19.099553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.099553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.099820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.101012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:19.101530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:19.102303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.102595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.102866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.104691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6807b8-df95-4f2b-ab60-e2d7d3c48e16 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:19.119002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 215/437] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:07:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:19.120100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.120527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.120848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.134475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:19.136089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:19.149633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:19.151659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:19.229207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:19.237243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 223/438] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:19.238168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:19.301924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 216/439] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:19.414622 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:19.425329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b52de6-8b7d-40a1-9ebe-1401de9283f4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:19.476293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:19.476956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.477229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.477505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.555165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:19.586962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:19.588471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:19.694002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20616a-04e2-4571-8f5c-0872e2e03ab8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:19.745864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:19.748393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:19.750306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.750306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.750306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.760873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 224/440] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:19.761794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:19.769942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:19.780016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:19.781693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:19.782641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:19.783632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 217/441] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:19.784833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:19.839815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:19.921986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e468-37f4-4889-8728-804ec26b733b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:19.924704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b36bfd-ddf6-4493-9fb1-e7efc392c00f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:19.973855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:19.975252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.975604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.976055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.977930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:19.980528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:19.982587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:19.983578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 218/442] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:19 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:19.983924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:19.984315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:19.984788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:19.984964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.003040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:20.011903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:20.013463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:20.014368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:20.015584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 225/443] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:20.016982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.104227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:20.138770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:20.142794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9f60-04d3-4bad-b689-3733b439101e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.171882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62992-b890-42bc-8602-e305f4018bfd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.197117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:20.197748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:20.198029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:20.198301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:20.198996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:20.199301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:20.200823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:20.211116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 219/444] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:20.212070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.225205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:20.226259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:20.226681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:20.227093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:20.229092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:20.231495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:20.239533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 226/445] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:20 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:20.239533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.334220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d7b1-452f-4749-9b86-c2450f5f5161 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.375856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:20.376535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:20.376961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:20.377324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:20.378105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:20.378526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:20.380242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:20.390849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 220/446] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:20.391823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.406841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1f97-7653-4612-83c4-534f681730be None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.423763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:20.448896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:20.468322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:20.469328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:20.469762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:20.470193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:20.527766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9cf0-b7d8-45e9-afb1-4bb3a2d4f4a0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.569644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:20.570381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:20.570719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:20.570822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:20.571087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:20.571907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=05dc7b23426a4cc49791c2e6585774ad, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:20.572280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:20.573594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:20.573897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:20.581284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 221/447] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:20 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=05dc7b23426a4cc49791c2e6585774ad => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:20.582252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.749565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:20.752279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 227/448] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:20.760204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:20.782909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794077-2197-42d2-abc5-f55cd4b8eb44 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.795264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:20.852195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:20.853197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:20.853639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:20.854086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:20.946991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069b00-452b-4eef-bd7c-a179a27dc255 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:20.982445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:20.984465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.007041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:21.007998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:21.009470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:21.009470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] PATH_INFO: `/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:21.011286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] RBAC: Authorizing `identity:get_project(project_id=c21f4c2bbfcf4e0f8ddce568cdfb4031)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:21.013906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.017115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 228/449] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:20 2022] GET /identity/v3/projects/c21f4c2bbfcf4e0f8ddce568cdfb4031 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:21.026349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:21.150316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:21.171670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 222/450] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:21.181197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:21.183715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:21.198612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f42d-d275-4145-9cd4-f85d2310ce29 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:21.239812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:21.240477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:21.240793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:21.241066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] PATH_INFO: `/v3/groups/f06a3c16c90d41aebb48492216c16836` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:21.242354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] RBAC: Authorizing `identity:get_group(group_id=f06a3c16c90d41aebb48492216c16836)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:21.243851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.245626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 229/451] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:21 2022] GET /identity/v3/groups/f06a3c16c90d41aebb48492216c16836 => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:21.252810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:21.339358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd1a6-2e04-414c-9c26-74e9a5cb05ca None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:21.383649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:21.384997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:21.385406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:21.385770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] PATH_INFO: `/v3/projects/41167c2035b74c5ca9df5ba5e1c86757` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:21.387267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] RBAC: Authorizing `identity:get_project(project_id=41167c2035b74c5ca9df5ba5e1c86757)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:21.388925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.390519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bfc1e-cb9c-4a2e-b4f1-036fc10f9d6e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:21.391269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 223/452] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:07:21 2022] GET /identity/v3/projects/41167c2035b74c5ca9df5ba5e1c86757 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:21.398382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:21.442704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:21.443452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:21.443859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:21.444197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:21.445422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] RBAC: Adding query filter params (group.id=f06a3c16c90d41aebb48492216c16836, role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=c21f4c2bbfcf4e0f8ddce568cdfb4031) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:21.445910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:21.447719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.455481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 230/453] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:21 2022] GET /identity/v3/role_assignments?group.id=f06a3c16c90d41aebb48492216c16836&scope.project.id=c21f4c2bbfcf4e0f8ddce568cdfb4031&role.id=73d94b00a1864422b65efc55999d79b0 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:21.490426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:21.575368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17c57-d42e-41c6-a333-1279f09f85e1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:21.644868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7549a-121f-4a8e-9e18-698b8c2ee146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:21.645876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7549a-121f-4a8e-9e18-698b8c2ee146 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:21.646370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7549a-121f-4a8e-9e18-698b8c2ee146 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:21.646860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7549a-121f-4a8e-9e18-698b8c2ee146 None admin] PATH_INFO: `/v3/groups/490e6f6b566b487fafc521a4016d96ff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:21.648875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7549a-121f-4a8e-9e18-698b8c2ee146 None admin] RBAC: Authorizing `identity:get_group(group_id=490e6f6b566b487fafc521a4016d96ff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:21.651559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7549a-121f-4a8e-9e18-698b8c2ee146 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.654718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 224/454] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Sep 1 05:07:21 2022] GET /identity/v3/groups/490e6f6b566b487fafc521a4016d96ff => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:21.662626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:21.709108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:21.839189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab406a-aea9-4b35-ad2b-aae4e06b27ce None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:21.897541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:21.898483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:21.898963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:21.899432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:21.900803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] RBAC: Adding query filter params (group.id=490e6f6b566b487fafc521a4016d96ff, role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=41167c2035b74c5ca9df5ba5e1c86757) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:21.901334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:21.904031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc579c-759f-429d-a85e-aa244dd73a0d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:21.915468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 231/455] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Sep 1 05:07:21 2022] GET /identity/v3/role_assignments?group.id=490e6f6b566b487fafc521a4016d96ff&scope.project.id=41167c2035b74c5ca9df5ba5e1c86757&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:24.794614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c27b68-fff2-4ac7-a8aa-01b34f901e49 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:24.795176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c27b68-fff2-4ac7-a8aa-01b34f901e49 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:24.795176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c27b68-fff2-4ac7-a8aa-01b34f901e49 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:24.797348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 225/456] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:24.803367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:24.803906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:24.803906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:24.833808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:24.835050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:24.908266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d150-50d8-49ea-8f9e-80da4dd69514 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:24.908642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d150-50d8-49ea-8f9e-80da4dd69514 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:24.908876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d150-50d8-49ea-8f9e-80da4dd69514 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:24.910586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 226/457] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:24.917718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:24.918047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:24.918277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:24.945288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 232/458] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:24.961925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:24.963244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:25.085659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 227/459] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:07:25.248555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:25.270443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:25.381055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73a11f-5b92-4efd-bd03-6d7a27e280f1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:25.421725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:25.422422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:25.422691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:25.422953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:25.435539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:25.437592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:25.455688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:25.457480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:25.459126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:25.459126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:25.459126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:25.459126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 233/460] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:25.463595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:25.516294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:25.599520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:25.606840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:25.666155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396242f-0e36-468b-8346-f044a7f44455 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:25.716265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:25.717632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:25.718005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:25.718311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:25.731678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316187-5f2d-40a7-8669-143b373a49f5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:25.737540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:25.739053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-8acddf1b-294c-47cd-9a89-c712837ba2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:25.758190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:25.760276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:25.763354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:25.763354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:25.763354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:25.763354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 234/461] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:25.763354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c9e6-4c10-4cc2-b380-3911ddfd06f3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:25.763354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c9e6-4c10-4cc2-b380-3911ddfd06f3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:25.764539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c9e6-4c10-4cc2-b380-3911ddfd06f3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:25.769012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 235/462] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:25.769977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c9e6-4c10-4cc2-b380-3911ddfd06f3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:25.782377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:25.783008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:25.783288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:25.784318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:25.785036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:25.785341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:25.787370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ff9cb-fdb6-4364-b097-e2eefe70fc48 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:25.808772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 228/463] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:25.811405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:25.811897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:25.812396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:25.836653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:25.837899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:25.930552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c9e6-4c10-4cc2-b380-3911ddfd06f3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:25.936709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 229/464] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:25.937608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:25.968316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:25.994042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:25.995147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:25.995730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:25.996171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:25.997399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:25.997923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:26.001347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f969650-818e-4bd6-93f8-0fa94a59ff6a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:26.005529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:26.040748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 236/465] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:26.040748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0526b-297e-4aff-9d1c-b3bfa30bb751 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.040748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0526b-297e-4aff-9d1c-b3bfa30bb751 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.040748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0526b-297e-4aff-9d1c-b3bfa30bb751 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.043543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 237/466] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:26.050761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0526b-297e-4aff-9d1c-b3bfa30bb751 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:26.087313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e579ab-10f5-47cb-833c-9bda58fe866e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:26.133112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a1bd3-9bb1-459e-a9fc-c6fdf78bd064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:26.134431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1bd3-9bb1-459e-a9fc-c6fdf78bd064 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.134914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1bd3-9bb1-459e-a9fc-c6fdf78bd064 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.136011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1bd3-9bb1-459e-a9fc-c6fdf78bd064 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.136916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a1bd3-9bb1-459e-a9fc-c6fdf78bd064 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:26.138595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a1bd3-9bb1-459e-a9fc-c6fdf78bd064 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:26.171997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 230/467] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:07:25 2022] POST /identity/v3/users => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:07:26.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.174662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.175170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.202514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:26.204124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:26.265640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0526b-297e-4aff-9d1c-b3bfa30bb751 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:26.305631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 231/468] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:26.350155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:26.364974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:26.369663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.370290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.370746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.371626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:26.377409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:26.423668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:26.425547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 238/469] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:07:26 2022] POST /identity/v3/users => generated 248 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:07:26.531559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dd167-d58b-48ac-b40c-b6d0557ad8f1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:26.577650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:26.578489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.578774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.579090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.592583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:26.594426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ccebab93-a677-4e1b-ad57-14096ecfac31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:26.613118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:26.614896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:26.618412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:26.618412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:26.618412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:26.618412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 232/470] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:26.621353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:26.680493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:26.710617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39914d3-96f2-4f31-b692-d2d87c727b9c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.710895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39914d3-96f2-4f31-b692-d2d87c727b9c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.711160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39914d3-96f2-4f31-b692-d2d87c727b9c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.715975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 233/471] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:07:26.725475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.725830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.726201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.747290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:26.748600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:26.781551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b5f0-5d92-4d5f-95ef-a49a76bc587e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:26.822809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:26.823453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:26.823802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:26.824075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:26.824992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:26.825300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:26.826878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:26.842318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 239/472] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:26.852325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:26.853082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 234/473] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:26.886261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:26.928485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:26.987181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:26.995139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bc7af-15dd-4004-98c4-342e8cbf1299 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:27.048317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:27.049000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:27.049269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:27.049530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:27.050194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:27.051674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:27.090140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d513a6-3d53-43ef-96c8-07489e2650fa None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:27.094737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 240/474] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:07:26 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:07:27.135313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:27.136000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:27.136375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:27.136738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:27.149480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:27.151027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:27.169280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:27.172660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:27.174367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:27.174367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:27.174367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.174367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 235/475] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:27.184252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:27.338961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:27.350182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53588dcf-6650-4032-844a-b05704f837eb None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:27.394505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:27.395140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:27.395409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:27.395676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:27.396433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:27.396778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:27.398313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:27.414216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 241/476] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:27.418259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:27.426983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:27.453026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:27.482465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee1cf-17d5-4168-a3c2-6934f2f5cc7f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:27.539015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:27.540957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:27.541266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:27.541546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:27.542281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:27.543715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:27.555491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.sql.core [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 05:07:27.555491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 05:07:27.555491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [parameters: {'id': '257f8c2d90fa4c558dd2c8c28323b1e4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 05:07:27.555491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81496) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application result.read() Sep 01 05:07:27.573438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:07:27.576903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application yield resource Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise self.value Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application session.commit() Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 05:07:27.588681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.session.flush() Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application compat.raise_( Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 05:07:27.591750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:07:27.595638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application result.read() Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:07:27.598772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [parameters: {'id': '257f8c2d90fa4c558dd2c8c28323b1e4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:27.605840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 05:07:27.608477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.611128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 236/477] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 1 05:07:27 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:27.611276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81b55-de71-4969-bfc3-319eaf04b5a2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:27.616923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:27.637587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:27.638049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:27.638323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:27.638582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:27.639447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:27.643418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:27.702948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 242/478] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:07:27 2022] POST /identity/v3/users => generated 249 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:07:27.796644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c18b71-fe9c-4906-9fb1-e0b92c774950 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:27.855668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:27.870926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e1bf8-885b-44fb-bbdf-be6ae78d789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:27.872490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e1bf8-885b-44fb-bbdf-be6ae78d789f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:27.874256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e1bf8-885b-44fb-bbdf-be6ae78d789f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:27.875037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e1bf8-885b-44fb-bbdf-be6ae78d789f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:27.902882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e1bf8-885b-44fb-bbdf-be6ae78d789f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ab6e1bf8-885b-44fb-bbdf-be6ae78d789f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:27.921186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:27.922180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:07:27.923008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:27.923625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 237/479] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:07:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:27.932278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:28.082812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:28.154233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dac6f0-5d41-4ddb-a413-f2a2c5762703 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:28.218405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:28.219525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:28.220003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:28.220471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:28.221755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:28.222291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:28.224877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46649e8e-5646-4076-bef7-7e02d3210131 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:28.241603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 243/480] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:28.769606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e996d21-e91d-4fc5-a04c-c4d4db9f9e75 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:28.769889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e996d21-e91d-4fc5-a04c-c4d4db9f9e75 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:28.770168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e996d21-e91d-4fc5-a04c-c4d4db9f9e75 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:28.772189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 238/481] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:28.778362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762eda16-d068-4e5f-b777-a0806031d693 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:28.778745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762eda16-d068-4e5f-b777-a0806031d693 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:28.779021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762eda16-d068-4e5f-b777-a0806031d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:28.802867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-762eda16-d068-4e5f-b777-a0806031d693 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:28.804114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-762eda16-d068-4e5f-b777-a0806031d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:28.908024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 244/482] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:29.274736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e996d21-e91d-4fc5-a04c-c4d4db9f9e75 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:29.370564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd1d4-7637-4e88-8fe1-39480223ed5e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:29.371113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd1d4-7637-4e88-8fe1-39480223ed5e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:29.371113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cd1d4-7637-4e88-8fe1-39480223ed5e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:29.372857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 245/483] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:29.387599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6375-46fa-4496-8052-3f52cfa74fe5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:29.387960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6375-46fa-4496-8052-3f52cfa74fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:29.388143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c6375-46fa-4496-8052-3f52cfa74fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:29.421218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7d8c6375-46fa-4496-8052-3f52cfa74fe5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:29.422565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7d8c6375-46fa-4496-8052-3f52cfa74fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:29.447028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e996d21-e91d-4fc5-a04c-c4d4db9f9e75 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:29.526090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:29.526748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:29.527025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:29.527291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:29.550195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:29.559770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:29.560831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:29.561677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:29.566258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 239/484] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:29.568271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:29.577444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:29.594090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 246/485] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:07:29.642460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:29.707240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57249c51-43e0-478e-9481-8b53f9b8926c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:29.714310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241035-7fa0-473a-a9a1-34939c9def87 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:29.714665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241035-7fa0-473a-a9a1-34939c9def87 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:29.714861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241035-7fa0-473a-a9a1-34939c9def87 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:29.716635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 247/486] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:29.722461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:29.722794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:29.723011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:29.756134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:29.756806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:29.757089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:29.757364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:29.758060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:29.758362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:29.760178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:29.762912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:29.764218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:29.780189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 240/487] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:29.787330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:29.935240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 248/488] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:29.936314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:29.964203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a72c6-10e5-4641-bad7-4f8fb4a83c6d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:29.976849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:30.012156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.013265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.013737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.014347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.035541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:30.037440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:30.060389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:30.061821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:30.063679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:30.063679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:30.063679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:30.063679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 241/489] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:30.069721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.104661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dfeea-946e-4fb1-9a16-cf5e34506690 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.153019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:30.174103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.174766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.175041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.175313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.204402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:30.213590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:30.214593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:30.215847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 249/490] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:30.224097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.243424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402462c1-baf5-458b-87f9-bb6e9fe8e094 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.317952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.319784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.324671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.324671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.324671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:30.324671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:30.325342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:30.348026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 242/491] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:30.349481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.386062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc3d0f-cc85-4aa6-86e7-57d0780a5225 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.396853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:30.429880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.430517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.430796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.431064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.431818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:30.432118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:30.433713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:30.444762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 250/492] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:30.445714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.519391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:30.548046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d05dd-e53d-4333-a1ac-272e1e4f7235 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.597621 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.599264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.599739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.600161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.616227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:30.620691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad9644-8fe3-42a9-8edc-c70fc830b22d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:30.622101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:30.623415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:30.624466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:30.628641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 243/493] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:30.629799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.673543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.674287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.674687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.675005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.685207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:30.687493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:30.703042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:30.704286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:30.705505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:30.709027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 251/494] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:30.710023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.753616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:30.778091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160850-3a02-422c-9f19-7c6e87d84181 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.820910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.821491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.821777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.822113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.834922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:30.836846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:30.851117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df0a42-40d0-4aca-9ec9-70f484d4ee47 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:30.854864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:30.855773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:30.856721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:30.857646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:30.857646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:30.857646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:30.858406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 244/495] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:30.858721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:30.906675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:30.907378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.907655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.907926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.908642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:30.908963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:30.910428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9222a-2a86-4da8-b5e9-dd82b1b9b669 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:30.921688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 252/496] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:30.923647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451d39-dd77-4649-b78b-b16590f955f6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:30.924116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451d39-dd77-4649-b78b-b16590f955f6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:30.924592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451d39-dd77-4649-b78b-b16590f955f6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:30.931489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 253/497] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:30.931489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451d39-dd77-4649-b78b-b16590f955f6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:31.010878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87dec-81b6-4be1-a57b-a649695ba282 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.058251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:31.058885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.059156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.059453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.060173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:31.060498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:31.062516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:31.064968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:31.074179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451d39-dd77-4649-b78b-b16590f955f6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.106422 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 245/498] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:31.107323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:31.117109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:31.117737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.118009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.118272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.118931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:31.119246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:31.120688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5f85-3008-48f7-b62b-47f4a1379a14 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:31.134414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 254/499] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:31.135724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7ca5-0707-405f-a6ba-37430ebf4e4a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.135996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7ca5-0707-405f-a6ba-37430ebf4e4a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.136256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7ca5-0707-405f-a6ba-37430ebf4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.156420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a2ce7ca5-0707-405f-a6ba-37430ebf4e4a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:31.157750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a2ce7ca5-0707-405f-a6ba-37430ebf4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:31.179296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:31.238918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6d38-f083-44a2-9d01-780449935a4e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.259490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 255/500] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:31.259787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046c9f0-5551-400a-8f6a-18b6d257a60d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.260134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046c9f0-5551-400a-8f6a-18b6d257a60d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.260528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046c9f0-5551-400a-8f6a-18b6d257a60d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.262126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 256/501] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:31.263391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046c9f0-5551-400a-8f6a-18b6d257a60d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:31.309175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:31.310143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.310648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.311098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.331608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:31.334330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:31.363841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:31.365754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:31.367346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:31.367346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:31.367346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:31.367346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 246/502] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:31.367751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:31.409948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046c9f0-5551-400a-8f6a-18b6d257a60d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.456262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:31.457243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.457826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.458540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.463838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:31.495116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:31.553726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dc45-dc31-4f9a-857b-d30ddcaead99 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.586146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:31.588982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:31.604214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:31.605199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.605888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.606269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.617980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:31.619680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e4c8543f-ce90-4709-bed3-406fa513ecb7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:31.639963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:31.642017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:07:31.643573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:31.648886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 247/503] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:31.652881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.653711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.654547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.688465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:31.690624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:31.752475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 257/504] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:31.753444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:31.800409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 248/505] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:31.800409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:31.824857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:31.863471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:31.909018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee418eb0-eeaa-4ba1-9a33-7375511ee825 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.971983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10e10-3082-4d3d-8e05-86c91634d55f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:31.980863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:31.982306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:31.983077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:31.983806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:31.985232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:31.986110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:31.988311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.008255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 258/506] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:32.010413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.048059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.049034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.049479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.049924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.051096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:32.051591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.053843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.084980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 249/507] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 1 05:07:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:32.086386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.180466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc4039-7e66-4abe-a6de-8ac3d4a08f00 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.204544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:32.208196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:32.219169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a85408-daf7-4f9a-9048-e4096b9cc1e6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.235911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.236982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.237447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.237918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.256924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.257578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.257730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:32.257903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.258122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:32.267677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:32.269372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 259/508] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:32.270834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.274531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.276120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:32.293874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:32.295502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:32.298029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:32.298029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:32.298029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:32.298029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 250/509] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:32.298029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.405566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fc109-e31d-4aa8-8260-7de10912de45 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.421204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f608c-a589-41a8-8f42-a5734d63b99e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.444454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.445255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.445382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.445550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.454094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.455587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.463665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.464853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.465686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.466154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:32.468204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:32.469175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:32.470091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 260/510] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:32.470659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.487345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.490114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.494385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:32.516220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:32.520266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:32.521317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:32.522187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:32.522187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:32.522187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:32.522363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 251/511] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:32.523890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.601746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6da0-f7d0-4553-81c2-724568b2ef60 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.641057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.641902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.642318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.642750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.651348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c602bdb-d931-4022-be1b-99cbc658e0c4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.691355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.692179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.692501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.692852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.693739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:32.694105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.695732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.706414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 252/512] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:32.707846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.729825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.731231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.770663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:32.782404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:32.835465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa97f9-ace1-47e3-8da9-4195c5b1551e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:32.853373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 261/513] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:32.854259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.877326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:32.878113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:32.878522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:32.878887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:32.879647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:32.880020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:32.881496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:32.896173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 253/514] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:32.897085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:32.975518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7f1a4-85a0-43c0-9a88-89c59d788e48 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.017199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.017824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.018091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.018350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.019133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:33.019424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.020942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.023396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:33.027435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970973-6bd4-40ce-83b3-1514d0483ca9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.062378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:33.067888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 262/515] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:33.068500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.091141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.091750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.092122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.092403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.093071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:33.093384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.094768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.107999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 254/516] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:33.109112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.202300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940d549-4ad8-47b2-9c8f-e230464e23a0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.245722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe240e-13a7-45c9-9dc8-c1e0537d41a6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.247906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.249559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.249559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.249559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.262599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.264874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:33.283668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:33.285684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:33.287592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:33.287592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:33.287592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:33.287592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 263/517] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:33.287592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.297574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.298592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.299029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.299469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.318071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.320516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:33.341091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:33.343049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:33.345127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:33.345127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:33.345127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:33.345127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 255/518] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:33.345127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.368424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:33.395610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:33.447784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d54af-1975-45a3-8b13-36bb36ebefa3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.493132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.493909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.494199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.494491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.494970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be00ad-a27e-4aa1-9b42-8e1f94386025 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.503016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.504521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:33.521689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:33.523360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:33.525071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 264/519] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:33.525996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.543761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.544697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.545109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.545498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.635531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.637474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.677143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:33.689177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e40272-5d46-493d-8968-fcf26bfd4eff None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.691877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:33.735676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:33.736415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:33.736823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:33.737204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:33.737988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:33.739871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:33.779009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 265/520] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:07:33 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:07:33.779009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.779382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 256/521] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:33.779382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:33.959585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24ef7d-7db1-458e-abb2-c983b35de153 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:33.960616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991f9b-0cc6-4586-a49e-4f006da26b21 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.017078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:34.027616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.028230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.028592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.029187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.029326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.029645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.030705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.030877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.031026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:34.031467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.031818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:34.032312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.034025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.034727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.057256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 257/522] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:34.060905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.063458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 266/523] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:34.064525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.097305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:34.191352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83057b-c97b-4e2a-a94f-14891c43c1de None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.227496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eabac-3904-41ec-859e-014065bee114 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.242644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.243282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.243561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.243830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.244552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:34.244885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.246381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.274133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 258/524] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:34.274133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.299269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.300051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.300611 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.301010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.316561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.319165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:34.340709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:34.341934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:34.343206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:34.343206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:34.343206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:34.346774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 267/525] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:34.347783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.351098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:34.423562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10748a9-50b3-4ab8-9106-77f531857789 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.448772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:34.480179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.481971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.482732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.482901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6954e7-6892-4537-ac45-9602c4a5aad7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.483551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.501835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.504468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:34.519049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:34.520871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 259/526] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:34.522518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.531223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.531898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.532164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.532421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.542118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.544223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:34.558892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:34.560612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 268/527] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:34.563023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.663843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec52c4-2575-4bd2-a906-5520ff7638c4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.678080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:34.691601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee03a-49d9-4efe-9093-6643ad4935ea None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.712792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.713624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.714075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.714499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.715588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a467a7344fff4987967c8655dc2965a1) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:34.716072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.717845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.732583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:34.737087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 260/528] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/role_assignments?user.id=a467a7344fff4987967c8655dc2965a1&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:34.738345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.740405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:34.741086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:34.741359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:34.741628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:34.742308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:34.742604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:34.744071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:34.764465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 269/529] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:34.765597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:34.939298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420a60-78e7-4fbc-94ea-000fcf021f67 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:34.944195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914a0a4-68ac-43aa-adae-350fa4984bd9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:35.004614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:35.005653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:35.006115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:35.006566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:35.007354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:35.007762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:35.008269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:35.009547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:35.010275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:35.010956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:35.011266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:35.012873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:35.013817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:35.018015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:35.041174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 261/530] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:35.042752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:35.058479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 270/531] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Sep 1 05:07:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:35.061366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:35.107282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:35.171689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:35.249959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b61a-5057-42d8-9af5-2c3f77b3d530 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:35.273930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad037-62f3-47f4-a914-d11941374894 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:35.321230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:35.322846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:35.323665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:35.324402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:35.337509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:35.337509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:35.337509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:35.337509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:35.338141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a847910274f346d5b0320b725599b14d) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:35.338141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:35.339415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:35.343475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:35.346551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 271/532] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:35 2022] GET /identity/v3/role_assignments?user.id=a847910274f346d5b0320b725599b14d&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:35.347055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:35.347438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:35.369108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:35.370714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:35.372191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:35.376480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 262/533] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:35.385431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:35.597203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:35.605629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132dd77-8fc8-4982-9cef-7a220aff67fc None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:35.636408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148e07-fb3e-43e2-8f59-b021e025d7ee None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:35.685205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:35.694702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:35.696285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:35.697078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:35.697853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:35.699555 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:35.700361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:35.705714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:35.734055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:35.736299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:35.736299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:35.736299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:35.741736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 263/534] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:35.756302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:35.974002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:35.975419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:36.082792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7101-13c3-4dba-b127-8060f1aa7cfe None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:36.163999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 272/535] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:36.173125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:36.190841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:36.191483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:36.191779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:36.192017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:36.192832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=9266a63ee919403f880344cfe2efb5a8) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:36.193145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:36.194653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:36.206939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 264/536] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:35 2022] GET /identity/v3/role_assignments?user.id=9266a63ee919403f880344cfe2efb5a8&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:36.242958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:36.338751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907b34e-7e7f-486e-a172-37f8a9d09189 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:36.396310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:36.397024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:36.397299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:36.397568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:36.417762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:36.419354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:36.437769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:36.439822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:36.441617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:36.441617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:36.441617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:36.441617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 273/537] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:36.446336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:36.509582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:36.737577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a75a4-27ed-4e51-b4a3-c0015a3fbe22 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:36.833922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:36.835433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:36.836189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:36.836962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:36.845933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:36.847108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:36.854344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a0f3-d236-4ae2-ab8e-5b977ccc2af9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:36.888948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 265/538] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:36.897561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:36.908825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1066d4-38a5-4d11-a5bf-249a85b07b4c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:36.909558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1066d4-38a5-4d11-a5bf-249a85b07b4c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:36.910119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1066d4-38a5-4d11-a5bf-249a85b07b4c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:36.912121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 266/539] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:36.921055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:36.921680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:36.922831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:36.960705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:36.962917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:37.055477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:37.143435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 267/540] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:37.188352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067adb7-9838-4ce1-b0f5-a3cc5c86fec7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:37.275053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:37.275709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:37.275982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:37.276252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:37.291106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:37.292638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:37.312071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:37.320400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:37.327460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 274/541] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:37.345539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:37.356411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:37.504771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb173fe-939e-4448-902a-b9d4fc00f00d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:37.578608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:37.579250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:37.579524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:37.579794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:37.580591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:37.580924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:37.582487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:37.602822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 268/542] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:37.612474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:37.757886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:37.963799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba238-3aec-42bb-b223-bae6c3f23784 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:38.006835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:38.023155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:38.056668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:38.058264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:38.058954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:38.059300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73702b03-6158-4f10-bf97-ac93c56757bb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:38.059900 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:38.062114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=98a43f7e512946aab3f1d7ef7b8d4fcc) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:38.064430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:38.067608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b8618-7a0b-44d9-a224-f3e1ae71fb41 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:38.089589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 275/543] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:37 2022] GET /identity/v3/role_assignments?user.id=98a43f7e512946aab3f1d7ef7b8d4fcc&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:38.092682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592389d-fbb3-4f16-ad6c-3b7e05855bb0 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:38.092682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592389d-fbb3-4f16-ad6c-3b7e05855bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:38.092682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592389d-fbb3-4f16-ad6c-3b7e05855bb0 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:38.098637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 276/544] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:38.100056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:38.100321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:38.100586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:38.127945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:38.128686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:38.128968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:38.129233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:38.148940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:38.148940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:38.151951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:38.163111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:38.164863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:38.166493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 269/545] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:38.176366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:38.335655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 277/546] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:38.438418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bf32b-7674-4bae-b8ad-e3013b8116dd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:38.497207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:38.515471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:38.517164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:38.517929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:38.518730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:38.520249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:38.521153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:38.524386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:38.543136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 270/547] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:38.551368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:38.719781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3dcbe-cae0-4bc9-b112-01cc3ebf8f00 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:38.750568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:38.776968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:38.777631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:38.778049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:38.778289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:38.793184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:38.795184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:38.823404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:38.825189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:38.827769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:38.827769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:38.827769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:38.827769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 278/548] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:38.834581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:38.880922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:38.998721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff082f7-4671-4d97-a7c3-6bfc28a1f3e8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.037542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b3e76-0563-401f-8d02-dee176c64abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.038192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b3e76-0563-401f-8d02-dee176c64abe None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.038523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b3e76-0563-401f-8d02-dee176c64abe None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.038791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b3e76-0563-401f-8d02-dee176c64abe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.052289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b3e76-0563-401f-8d02-dee176c64abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-212b3e76-0563-401f-8d02-dee176c64abe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:39.058817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:39.061494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:39.063341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:39.065146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 279/549] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:39.066730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a675e4-14e1-4c07-8ae6-d034065c8aea None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.072111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a675e4-14e1-4c07-8ae6-d034065c8aea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.072111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a675e4-14e1-4c07-8ae6-d034065c8aea None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.072111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 280/550] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:39.072722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf90566-108f-4416-b679-df5bb46bba39 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.074872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf90566-108f-4416-b679-df5bb46bba39 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.074872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf90566-108f-4416-b679-df5bb46bba39 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.075801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 281/551] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:39.077216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf90566-108f-4416-b679-df5bb46bba39 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:39.097478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0bdf8-2749-4273-bc5e-69a3a54d7377 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.135901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:39.175153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.176193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.176721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.177188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.178366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:39.178877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:39.181415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f47cfa-e24c-4b24-a487-dd7078a29a8d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:39.210296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 271/552] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:39.210296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11984f-15df-4eac-adb7-d173e4f4ea40 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.210296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11984f-15df-4eac-adb7-d173e4f4ea40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.210296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11984f-15df-4eac-adb7-d173e4f4ea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.231974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9d11984f-15df-4eac-adb7-d173e4f4ea40 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:39.233900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9d11984f-15df-4eac-adb7-d173e4f4ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:39.264837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf90566-108f-4416-b679-df5bb46bba39 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.297071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:39.322542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 272/553] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:39.323671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.324067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.324442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.344896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:39.345800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.346378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:39.347341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.348073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.349266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.352285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:39.353307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:39.357289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:39.378003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 282/554] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:39.381269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:39.464719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 273/555] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:39.464719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:39.574899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:39.604766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51774f-ea32-4238-85af-f0ec7207e91e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.635181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba954-9d64-4695-86ff-36c262623875 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.653028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:39.678540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.679409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.679781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.680146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.692180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:39.693946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:39.712329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:39.713757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:39.714904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:39.714904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:39.714904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:39.716337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 274/556] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:39.722231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:39.733538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.734504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.734959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.737602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.751836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:39.754473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:39.782310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:39.783700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:07:39.785124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:39.795998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 283/557] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:39.798609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:39.905734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8135-5f2d-4241-80a5-88533b733055 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.927692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5a72-f4d8-44dc-97be-f6028ec9823f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:39.950051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.951177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.951515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.951848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.952577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:39.952998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:39.955033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:39.969343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:39.969960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:39.970231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:39.970493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:39.971120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 275/558] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:39.971229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:39.971517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:39.972433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:39.973022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:39.997755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 284/559] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:39.997755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.015103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:40.022039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:40.142557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930bfb6-39eb-4cbf-9ebd-ac655c7b11dd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.174510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4204a-af20-4bb7-9b28-be0484121602 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.190478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.191132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.191408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.191676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.205210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:40.210151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:40.211203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:40.212053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 276/560] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:40.213338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.225405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.226293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.226293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.226553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.238699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:40.244063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:40.245258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 285/561] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:40.246152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.322198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:40.334179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:40.345829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab956-204f-42bd-8911-ef73c25449a3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.367325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf84e2-d8d4-4f27-afda-3c7835d60857 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.388825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.389589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.389863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.390127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.398391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:40.399880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:40.409031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.410126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.410603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.411070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:40.413381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:40.414492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 277/562] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:40.415464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.508274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:40.510182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:40.573980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317abadc-06ee-49ad-a226-f507846b3ac9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.635632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:40.644832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.645836 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.646295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.646799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.647984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:40.648526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:40.651122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:40.675691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 278/563] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:40.677386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.678120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 286/564] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:40.682883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.684446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:40.842787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085fb29-f506-4d2a-81e8-85e65dd6823e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.854513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8769-6e46-4f70-b6a7-f495ff1e2c38 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:40.908066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.910143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.910839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.911551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.912258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:40.913250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:40.913424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:40.913734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:40.914184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:40.914792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:40.915471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:40.915972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:40.918009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:40.918387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:40.939634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 279/565] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:40.943064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 287/566] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:40.947081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.950331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:40.996310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.045092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.088773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59933dfe-0c69-492a-b3a6-0bd9004e43ba None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.095168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a6cc-356b-43a9-8723-679072f24c01 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.127770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.128420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.128722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.128987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.142033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.143575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.151016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.151880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.152276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.152656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:41.167081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:41.168706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:41.169777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:41.169777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.169777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:41.169777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 288/567] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:41.170014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.171930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.175982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:41.197631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:41.198715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:41.199635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:41.199635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.199635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:41.199635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 280/568] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:41.200863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.290884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.315304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39565b-ccd9-4cb4-8b59-1899f4f85e2c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.340809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db58c0-60cd-4011-9648-e85c34903cf4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.359789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.360468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.360925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.361276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.363440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.376054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.377971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.387281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.388023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.389048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.389048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1a0ad260-8346-49ec-b782-8d4e2f7bc4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:41.395977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:41.397980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:41.399704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:41.399704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.399704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:41.399704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 289/569] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:41.400115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6235-957c-43df-b6c0-87a90c1777e8 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.400803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6235-957c-43df-b6c0-87a90c1777e8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.401084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6235-957c-43df-b6c0-87a90c1777e8 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.403427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 290/570] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:41.405338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c6235-957c-43df-b6c0-87a90c1777e8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.408854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.411070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:41.429741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:41.431801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:41.434908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:41.434908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:41.434908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:41.434908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 281/571] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:41.434908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.561249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c6235-957c-43df-b6c0-87a90c1777e8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.574922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaf0f8-6fa8-4fb0-8094-1037d8a054f9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.612482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.613377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.613758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.614184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.615190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:41.615629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.618054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.620654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.634047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.635012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.635382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.635825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.636936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:41.637382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.640226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cbce6-84dc-47ff-9e58-6554a6b1f2a3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.646147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 291/572] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:41.646147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.660096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 282/573] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:41.662288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.662752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.663234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.688658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:41.690182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:41.720254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.777502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 283/574] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:41.777861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738081-cd7f-40a0-b05b-daeb1f14fbc4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:41.779367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.825148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:41.826223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:41.826647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:41.827042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:41.827912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:41.828424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:41.830486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:41.846597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 292/575] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:41.848085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:41.954657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:41.961682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f6c5-285a-462a-a116-042ba14d8c71 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.017620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.018647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.019131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.019610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.020810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:42.021329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.023969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.045701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e31d7-01d2-4725-a4c6-4390e0078401 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.056677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 284/576] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:42.056677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.098525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.104248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.105452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.105679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.106133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.119947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.122613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:42.146980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:42.147978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:42.148947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:42.149388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 293/577] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:42.150487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.239497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd4aa-52c1-4032-a977-ccfa73b95995 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.293156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.294248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.294762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.295236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.298416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a744b-8545-4fac-9fb8-c41b4d9e7b40 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.309883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.312657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.315372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:42.334670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:42.336497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:07:42.338660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:42.343546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 285/578] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:42.344783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.346222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.346885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.347158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.347438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.356807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.358624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:42.371782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:42.373878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 294/579] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:42.376993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.464028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.490395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aec3c-d8ce-4598-8f30-6bd1be02eb9a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.498980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643c77-ca0a-4a1b-b41c-9bbbe4ccf659 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.537218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.538306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.538729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.539119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.546074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.547214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.547664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.548114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.549482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:42.549999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.551044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.552500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.553565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:42.576027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:42.577329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:42.578579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 286/580] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:42.579488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.585584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 295/581] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:42.586948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.643030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.720571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291336-ae27-4b2a-8c64-29cd28b45ea8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.733993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb8229-21af-49b0-be18-d7fc28f23d42 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.761123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.761730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.762014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.762258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.772110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.776504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:42.783734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:42.784858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:42.785732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 287/582] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:42.787835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.800194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.801280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.801747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.802223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.803626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:42.804172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.807065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.840778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 296/583] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:42.842637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:42.920568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c19c-48d2-4cbb-9a4e-aa140ec8855b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.964372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:42.965233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:42.965358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:42.965561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:42.966317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:42.966698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:42.968185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:42.976914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.988662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 288/584] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:42.989232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e4a0e-e57d-4323-892c-87aa17693d09 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:42.989612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.032601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.033551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.033825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.034091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.034820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:43.035117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.036594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.050951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 297/585] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:43.051843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.063421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:43.123226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2da496-5f8f-4df5-ae5e-0f3a44643e02 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.165832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.166579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.166967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.167321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.168160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=594ce9d8a0164a559fa14327d308c7b0) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:43.168602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.170318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.176660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 289/586] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:42 2022] GET /identity/v3/role_assignments?user.id=594ce9d8a0164a559fa14327d308c7b0&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:43.177540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.197589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a6579-9b49-4aa4-a084-b4df4f436bb3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.251598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.252327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.252666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.252936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.253645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:43.253945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.255546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.266746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 298/587] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:43.267646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.292372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:43.326650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8dc4-3644-4a7d-a95d-190859bfdad4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.354462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:43.372797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.373643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.373918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.374189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.395012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.395012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.416102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2f2f-5bdf-42ec-b32b-1aa3006b20c5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:43.422890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:43.423945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:43.424895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:43.424895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:43.424895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:43.425076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 290/588] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:43.426493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.467259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.467989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.468324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.468679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.484197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.485951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:43.507348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:43.508764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:43.509793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:43.509793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:43.509793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:43.509793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 299/589] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:43.511101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.575851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587ca5c-92f4-48df-8d86-22b6dd4e564c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.609261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:43.622121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.622965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.623420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.624010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a467a7344fff4987967c8655dc2965a1/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.641329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=a467a7344fff4987967c8655dc2965a1, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.642980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.659266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 291/590] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:07:43 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a467a7344fff4987967c8655dc2965a1/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:43.659843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.666418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1450c0-2803-4c58-87c6-294fa2172dfd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.700059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:43.750530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.751496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.751951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.752401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.772588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.775046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:43.799810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:43.801084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:43.802108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:43.802108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:43.802108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:43.804968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 300/591] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:43.806510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:43.845914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc2da-dfe8-4a4a-b461-4883987616b7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:43.897524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:43.898720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:43.899162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:43.899431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:43.900100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:43.900398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:43.902154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:43.917321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 292/592] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:43.918911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.035317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ddddc-6f5f-4650-892e-6f717fc2000f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.066058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516481ee-b123-499b-ad32-e227533a5924 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.068257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:44.083633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:44.112263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.112987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.113356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.113800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.114901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:44.115831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.119112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.128960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.131282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.131927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.132510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.134887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:44.135969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.137953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 293/593] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:44.139192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.139367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.177366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 301/594] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:44.180550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.264567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4a4f-f67f-41f8-b4cd-71c6ec27a577 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.306001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.307050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.307820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.308210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.310716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ac12-ba85-490a-b1d7-a022caeecd12 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.316756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.318404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:44.331563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:44.333535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:44.335501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:44.344657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 294/595] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:44.344657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.346969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:44.355573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.356495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.357113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.357697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.366965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.368955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:44.383603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:44.385152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:07:44.386373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:44.393507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 302/596] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:44.394803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.443201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:44.471021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83072a-9978-4429-9c50-dbbc19f027a1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.517958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.518713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.519042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.519374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.520413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8408a-95eb-4198-b2fe-931d72c2a858 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.528262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.530293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:44.544155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:44.545340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:44.546366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:44.550801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 295/597] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:44.552086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.567327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.568479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.569033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.569501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.570435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:44.570993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.573075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.592887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 303/598] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:44.594288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.630548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:44.677698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8d17-ed3d-4fc6-9208-fa684d5acf91 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.714351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:44.719841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2527f-fe1d-465f-a638-33e5e305f2a0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.730027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.731037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.731534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.732085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.735141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:44.735692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.738479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.762537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.763701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.764187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.764801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.765758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:44.766289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.768176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.780810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 296/599] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:44.780810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.789280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 304/600] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:44.790686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:44.908368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ab6a-af2d-4f04-9a3a-a979139730ac None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.949403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:44.950504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:44.951201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:44.951736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:44.966524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:44.968827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:44.982958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920e19-29ae-44dc-af48-36db9358e551 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:44.986330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:44.987317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:44.988242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:44.988242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:44.988242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:44.990838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 305/601] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:44.992165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:45.007242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.032186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.057151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:45.058107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:45.058512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:45.058912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/9266a63ee919403f880344cfe2efb5a8/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:45.089781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=9266a63ee919403f880344cfe2efb5a8, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:45.092583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:45.120650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 297/602] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:07:44 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/9266a63ee919403f880344cfe2efb5a8/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:45.120650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:45.126444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7adba-5bc0-42ce-b62d-a1aeba4cc052 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:45.191152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:45.192213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:45.192731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:45.193242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a847910274f346d5b0320b725599b14d/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:45.212435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=a847910274f346d5b0320b725599b14d, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:45.214400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:45.238264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 306/603] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:07:44 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a847910274f346d5b0320b725599b14d/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:45.346203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef9dd-68d6-4d9d-8d4c-76292291c582 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:45.402531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:45.403655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:45.404463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:45.405021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:45.406002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:45.406541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:45.408307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:45.430236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 298/604] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:45.437515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:45.524279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.577074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199b99-d96b-440f-ab29-7fa38c8da6a4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:45.642939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:45.644505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:45.645328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:45.646099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:45.672004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:45.675586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-93ffd26b-7321-4b64-9aa6-afdde3e03d0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:45.708248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:45.709948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:45.711673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:45.715927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 307/605] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:45.725860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:45.783664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7eae-478d-4a15-8ad4-a26c6a01ce50 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:45.785488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7eae-478d-4a15-8ad4-a26c6a01ce50 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:45.786638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7eae-478d-4a15-8ad4-a26c6a01ce50 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:45.788852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.791615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 308/606] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:45.802864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd43fd-67e2-484d-8e68-7341133dfbe5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:45.803791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd43fd-67e2-484d-8e68-7341133dfbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:45.804826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd43fd-67e2-484d-8e68-7341133dfbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:45.842585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a8bd43fd-67e2-484d-8e68-7341133dfbe5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:45.846556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a8bd43fd-67e2-484d-8e68-7341133dfbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:46.001686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709775c-9ac2-40b5-a922-03401e7f739c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:46.044319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 309/607] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:46.049732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4a8fb-1361-486a-b87a-94f0983b24bd None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:46.049732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4a8fb-1361-486a-b87a-94f0983b24bd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:46.049732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4a8fb-1361-486a-b87a-94f0983b24bd None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:46.056658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 310/608] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:46.056658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:46.056658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:46.056658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:46.076725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:46.076725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:46.101789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:46.104171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:46.104942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:46.105656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:46.108231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:46.109173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:46.120658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:46.130176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:46.157382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 299/609] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:46.163553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:46.185791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 311/610] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:46.361524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:46.376891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5b6e-08e8-4fe0-bd6d-4002e33d2575 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:46.443587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:46.444740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:46.445212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:46.445682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/98a43f7e512946aab3f1d7ef7b8d4fcc/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:46.473619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=98a43f7e512946aab3f1d7ef7b8d4fcc, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:46.476254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:46.511015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 300/611] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:07:46 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/98a43f7e512946aab3f1d7ef7b8d4fcc/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:46.589596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:46.604528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:46.743618 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b90f3-abaf-4607-bc1c-09e26349725e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:46.791312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:46.792413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:46.793065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:46.793576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:46.807690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:46.817693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:46.818783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:46.819868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:46.823482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 312/612] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:46.830144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:46.835742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9260d7-5f7f-4442-a374-50c2fa706f1b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:46.904093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:46.910138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:46.910891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:46.911178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:46.911453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:46.942324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:46.948699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:46.950461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:46.952086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:46.953635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 301/613] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:46.961535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:46.966566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:47.050814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940897ca-6f14-4334-84d1-863b0351ec1d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:47.126785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577eab-cc48-4bb9-aa4e-cf0e12b7119e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:47.133699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:47.134657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:47.135152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:47.141641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:47.142641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:47.143126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:47.144819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:47.160760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 313/614] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:47.166196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:47.215600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:47.219068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:47.219782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:47.220256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:47.224297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:47.225196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:47.228389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:47.257244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 302/615] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:47.264411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:47.429158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:47.496274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e16e8-b2db-43da-b766-f4afb461a46a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:47.504481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:47.553913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3d0fc-893d-4106-a19b-68c45e6ba960 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:47.608918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:47.609602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:47.609884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:47.610157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:47.613853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:47.614570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:47.614790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:47.615054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:47.640131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:47.642613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:47.644135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:47.645131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:47.673709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:47.674769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:47.675675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:47.675675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:47.675675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:47.675675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 303/616] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:47.682892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:47.690123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:47.691744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:47.693882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:47.693882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:47.693882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:47.696793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 314/617] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:47.705674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:47.879114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89708-fc43-4e5a-bb2b-4bfea083bc10 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:47.931160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:47.933553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:47.933875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:47.934079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:47.934681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:47.939116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:47.939116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:47.954095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 315/618] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:47.963592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:48.001140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:48.006158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e992-6052-4567-b6b4-41a2879247ad None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:48.052557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:48.098786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:48.099874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.100371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.101181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.102359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:48.103273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:48.105846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500fb0-d6f8-4d94-a8a2-17d6cc4e6545 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:48.137137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 304/619] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:07:48.140656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095ffb-71ff-488e-a763-f30ce3d8372b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.140656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095ffb-71ff-488e-a763-f30ce3d8372b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.140656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095ffb-71ff-488e-a763-f30ce3d8372b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.141413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 305/620] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:48.146498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e095ffb-71ff-488e-a763-f30ce3d8372b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:48.150482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410d26c-8a10-41ba-a75a-1f1ae3ea073e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:48.201488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:48.202968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.203248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.203524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.214871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:48.217723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-53c3f9f4-483d-4007-836a-cb6adcfaf276 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:48.237720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:48.240448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 316/621] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.242617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.246302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.268481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:48.270604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:48.298557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e095ffb-71ff-488e-a763-f30ce3d8372b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:48.343849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:48.344903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.345341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.345768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.358350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:48.360991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:48.384683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 317/622] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-9deb50d7-04a1-4b28-bd32-96623db7cefc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:48.384896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:48.385834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:48.386805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:48.387362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:48.392006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 306/623] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:07:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:48.392435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436a0c-641c-406a-91f7-8cd641b3a66e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.392911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436a0c-641c-406a-91f7-8cd641b3a66e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.393363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1436a0c-641c-406a-91f7-8cd641b3a66e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.395468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 307/624] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:48.395712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:48.403126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1436a0c-641c-406a-91f7-8cd641b3a66e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:48.464848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:48.575098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1436a0c-641c-406a-91f7-8cd641b3a66e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:48.602248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af5fb-a846-4045-827c-d5cf9a549900 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:48.646673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:48.647668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.647668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.647921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.648768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:48.649244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:48.651264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5f72d-397b-48af-a8fd-4e3ac2e7733d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:48.656542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:48.658148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.658898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.659547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.660975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:48.661697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:48.665504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:48.688892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 318/625] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 1 05:07:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:48.691316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.691908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.692522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:48.705423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 308/626] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:07:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:48.708830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:48.734030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:48.737591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:48.863338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:48.879690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:48.892677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 319/627] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:48.892677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:48.904488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697269-fd79-49e8-bff5-6997947cdd7d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:48.986275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:48.987381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:48.987857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:48.988336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.014723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:49.019076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:49.062864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:49.064750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:49.066490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:49.066490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:49.066490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:49.066490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 309/628] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:49.072764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.121042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85f1e-eed2-40ea-b311-f732906cdac5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:49.190165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:49.191181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.191649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.192116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.278668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542faf-c720-4005-82be-b453d3efdf95 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:49.307505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:49.329625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:49.332701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:49.350318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:49.351255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.351816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.352372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.372192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:49.382080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:49.384660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:49.386585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:49.396586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 310/629] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:49.398786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.414763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:49.507753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 320/630] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:49.507753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.600046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669015c-8bf9-4720-a3b9-ccf31e281ed9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:49.650760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:49.652465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:49.653363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.654195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.654613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.655613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:49.656019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:49.657905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:49.663444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac398-f1d6-43c4-8220-35c17d325b14 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:49.677322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 311/631] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:49.678646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.710082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:49.710814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.711193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.711512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.726000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:49.730979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:49.737071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 321/632] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:49.738692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.791899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:49.838619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a8932-0d25-4ef3-b265-da9d74d865ec None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:49.857194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd368d0-9412-4625-a5f7-2e88c73fac4d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:49.892589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:49.893537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.893971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.894396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.895476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:49.895959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:49.898198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f9c95-b8be-4c29-92a9-3e8c56840374 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:49.909552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 312/633] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:49.911230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ece07b-95ab-4551-8ff0-8648947b3667 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.911649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ece07b-95ab-4551-8ff0-8648947b3667 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.911982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:49.912192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ece07b-95ab-4551-8ff0-8648947b3667 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.913092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:49.913566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:49.914293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:49.914451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 313/634] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:49.915344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ece07b-95ab-4551-8ff0-8648947b3667 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.936814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:49.939296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:49.964146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:49.965324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:49.966310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:49.966310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:49.966310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:49.966310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 322/635] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:49.967463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:49.975682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:50.067635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ece07b-95ab-4551-8ff0-8648947b3667 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.101122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:50.110735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9449-fb6c-4acf-ad0f-eb28f96f700f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.111950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.112606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.112921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.113176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.122267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.123856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:50.137225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:50.139484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 314/636] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:50.141561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.163227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.163996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.164326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.164786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.165672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:50.166062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.167562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703aa20-d015-4997-a21b-56c063512d55 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.177804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 323/637] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:50.179913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.180371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.180865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.203741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:50.205048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:50.270810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:50.280659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 324/638] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:50.282070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.302312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a08d-9168-48eb-bbdd-f6651ad36914 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.349606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.350263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.350564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.350812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.371698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.374520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:50.403829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:50.406078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:50.409274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:50.409274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:50.409274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:50.409274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 315/639] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:50.409274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.460073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df4aff-fa49-482a-ae20-f423ad2ccc9c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.491015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:50.507340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.508736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.509014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.509282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.510353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:50.510700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.512076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.528998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 325/640] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:50.534785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.606030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3b78c-5205-433b-ab34-f45ec608b6b2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.636553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:50.661115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.662458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.662886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.663318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.664443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:50.664955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.667455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.682904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 316/641] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:50.683799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.711092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c39cf7-baf7-4c8a-b850-815aa2efffa6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.765450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.766059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.766560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.766560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.779828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.781462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:50.803152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:50.805147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:50.807177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:50.807177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:50.807177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:50.807177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 326/642] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:50.808969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.820098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:50.824518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be1b9b-bb5f-400e-91e3-33ae9ea7ef05 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.867444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:50.868252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:50.868713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:50.869052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:50.869816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:50.870199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:50.871930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:50.887056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 317/643] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:50.888453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:50.954089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72aef6-32af-4a82-b640-408ef5545c1f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:50.965610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:51.001054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.002001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.002431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.002865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.015485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.017902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.031610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee5efe-8942-431c-b282-a0fc83103cc4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:51.032350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:51.034112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 327/644] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:51.036213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.083309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.084395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.084943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.085433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.103297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:51.109198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:51.111072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 318/645] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:51.112855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.145401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:51.193010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbc1db-5e00-43a9-a9a8-0e0c3354ea69 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.246736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.247518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.247791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.248057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/594ce9d8a0164a559fa14327d308c7b0/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.278609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=594ce9d8a0164a559fa14327d308c7b0, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.281149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.286335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f7c5-69b6-41a2-a856-4b6ea6fe1b76 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.298924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 328/646] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:07:51 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/594ce9d8a0164a559fa14327d308c7b0/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:07:51.300068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.324338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:51.362334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.363407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.363992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.364455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.366058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:51.366547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.370464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.405005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 319/647] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:51.406461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.537365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27dc4-789f-41c9-8945-aaed228e632f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.595792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:51.607446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.608168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.609051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.609342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.620155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.622665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:51.643379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:51.644691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:07:51.645905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:51.646603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad184a-0aa3-4b90-9141-96b9a0c020d4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.648916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 329/648] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:51.651250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.697508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.698052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.698334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.698609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.699319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:51.699622 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.701489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.723155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 320/649] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:51.723155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.785479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:51.815187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b90b9c-9dbe-4e2b-80f9-3fd171bfa3e1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.856185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.858755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.858755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.858755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.858755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:51.859205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.860463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.874123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 330/650] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:51.875311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:51.884231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30b590-6679-4c3e-b67c-cde59c06d0c2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:51.946879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:51.948230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:51.948833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:51.949200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:51.960752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:51.962958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:51.967208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:51.979748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:51.982104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 321/651] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:51.984542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:52.046306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fe81-0b32-4dcd-92da-ee7339f6a4d6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:52.102125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:52.103081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:52.103548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:52.103943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:52.105319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:52.105752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:52.108483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:52.127791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:52.146769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 331/652] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:52.148230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:52.159486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355572d4-4ef4-4120-882a-ed637c33e437 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:52.226157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:52.227099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:52.227581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:52.228061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:52.229520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a467a7344fff4987967c8655dc2965a1) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:52.230047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:52.232903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:52.244189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 322/653] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:51 2022] GET /identity/v3/role_assignments?user.id=a467a7344fff4987967c8655dc2965a1&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:52.245724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:52.319986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f923b7-aa5d-47ee-84fe-14ada15bf529 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:52.390430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:52.392168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:52.393090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:52.393823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:52.398980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:52.420687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:52.423753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:52.454813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:52.456373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:52.458576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:52.458576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:52.458576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:52.458898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa663-351c-4645-8f95-b00a23285763 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:52.462370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 332/654] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:52.464554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:52.500136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:52.500783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:52.501096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:52.501357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:52.502113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:52.502890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:52.503985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:52.528206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 323/655] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Sep 1 05:07:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:52.530664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:52.560087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:52.673786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069bd67-a51d-4383-8ab7-2c54efd8b147 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:52.740210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9f4e5-9c11-40a1-b976-30802357f8c0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:52.745187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:52.746217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:52.746683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:52.747159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:52.788436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:52.812682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:52.813777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:52.814312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:52.814792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:52.816253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:52.816821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:52.819512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:52.848428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 324/656] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:52.850405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:52.877998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:52.880851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:52.989206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:53.053343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 333/657] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:53.054395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.078757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114170-cd32-4d06-be9d-a2bc73b2d393 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.144361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.145368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.145845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.146258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.175898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43d04-8252-4ec4-ad5a-e12ba3c649b5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.208492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:53.217445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.218113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.218388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.218658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.227251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:53.228805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:53.234813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:53.236934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:53.243466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:53.245625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:07:53.247821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:53.250198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 334/658] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:53.251289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.266728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:53.372664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e406ecc-5a02-4e14-a889-3effb7d07f43 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.413491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.414729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.415008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.415279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.430244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:53.431997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:53.451644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:53.454377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:53.456087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:53.456087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:53.456087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:53.456087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 335/659] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:53.456087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.458395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 325/660] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:53.465097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.550173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:53.613261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec242952-4309-4446-949e-bd3bb048db35 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.622894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:53.653573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.654058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba378e-a333-4054-99f9-76c43ca86a2b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.654438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.654893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.655169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.655958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:53.656261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:53.657973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:53.680894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 336/661] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:53.681890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.705622 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.706620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.707082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.707538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.720647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:53.722193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-45c4dfbf-ff7b-49df-9ac9-ba8f5b00c0f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:53.739878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:53.741160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:53.742118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:53.742118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:53.742118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:53.742118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 326/662] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:07:53.742942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea8c7d-00d2-448c-8313-c38298f48c2c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.743223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea8c7d-00d2-448c-8313-c38298f48c2c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.743496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea8c7d-00d2-448c-8313-c38298f48c2c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.749075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 327/663] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:53.750052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea8c7d-00d2-448c-8313-c38298f48c2c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.820467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba7e82-9807-476e-b50e-7afe5e8927b9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.845390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:53.872342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.873369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.873709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.874090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.875226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:53.875745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:53.879200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:53.901247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea8c7d-00d2-448c-8313-c38298f48c2c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:53.905111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 337/664] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:53.907691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:53.961723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:53.962751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:53.963211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:53.963703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:53.968096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:54.088640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.091691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.099874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967439-1efd-4430-89b0-4e56bd8eb2ba None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:54.142832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:54.143507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.143667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.143917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.144519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:54.144869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.146254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbfbf4-b3fb-4342-ad57-f02baef9b766 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.168176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 338/665] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:54.168176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.168176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.168176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.188501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:54.189922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:54.251429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:54.280970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 328/666] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:54.282570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:54.322735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 339/667] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:54.324786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:54.343549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:54.502117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d5e2-7cdd-436a-9637-592e973914c3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:54.551675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7241a4-7d42-4fa2-931b-857c3ed1b426 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:54.578914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:54.580028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.580647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.580967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.594704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.597464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:54.620190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:54.622256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:54.624105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:54.629255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 329/668] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:54.631477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:54.636578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:54.638509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.640739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.641411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.657338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.661329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:54.689016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:54.691037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:54.692884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:54.697208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 340/669] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:54.698781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:54.789630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:54.836254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:54.847283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b50c6-8713-47c0-9406-e1da7f2b88bb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:54.898526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa6ebb-5562-465f-b4ba-060c16038b29 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:54.911674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:54.912777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.913255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.913722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.931945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.934252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.947682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:54.948306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.948576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.948871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.949583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:54.949872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.951413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:54.960092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:54.961978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:54.963834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:54.963834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:54.963834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:54.963834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 330/670] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:54.963834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:54.969396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 341/671] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:54.970566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.076857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:55.092942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0ae0e-4560-4b52-bea1-c9fe03f78e95 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.126830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d57e-ac5d-4120-884c-70481aba489e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.130606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3e76-4e94-457c-b4df-701e76513aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.131266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3e76-4e94-457c-b4df-701e76513aee None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.131532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3e76-4e94-457c-b4df-701e76513aee None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.131804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3e76-4e94-457c-b4df-701e76513aee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.144177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3e76-4e94-457c-b4df-701e76513aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2c4e3e76-4e94-457c-b4df-701e76513aee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:55.149656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:55.151340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 342/672] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:55.152987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71adc-fa0d-44e5-bc8a-e55b20324284 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.154668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71adc-fa0d-44e5-bc8a-e55b20324284 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.154668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71adc-fa0d-44e5-bc8a-e55b20324284 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.154668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 343/673] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:55.154997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71adc-fa0d-44e5-bc8a-e55b20324284 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.184465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.186182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.186535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.196388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.196388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:55.196388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.196388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.206364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 331/674] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:55.207362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.222361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:55.304927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71adc-fa0d-44e5-bc8a-e55b20324284 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.348877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.349626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.350003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.350696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.351326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:55.351798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.353517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.357138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffae39-ec82-436c-a36a-6321f9f34043 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.370263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 344/675] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:55.371204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.394242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:55.409933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.410796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.411218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.411600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.412468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=9266a63ee919403f880344cfe2efb5a8) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:55.412947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.415221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8abd4-5182-4168-b764-b935b2b0a3c2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.424327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 332/676] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/role_assignments?user.id=9266a63ee919403f880344cfe2efb5a8&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:55.426087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aba26c-6889-4739-8237-0f952e827872 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.426319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aba26c-6889-4739-8237-0f952e827872 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.426692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aba26c-6889-4739-8237-0f952e827872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.451234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-94aba26c-6889-4739-8237-0f952e827872 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:55.453306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-94aba26c-6889-4739-8237-0f952e827872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:55.549584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d091-4c6e-4378-aa1b-da7602472dd2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.567665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:55.585150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 333/677] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:55.588188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aba26c-6889-4739-8237-0f952e827872 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.602922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.603525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.603780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.604000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.604704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:55.605004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.606641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.624673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 345/678] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:55.624673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.756984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:55.776955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aba26c-6889-4739-8237-0f952e827872 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.827425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b6586-87fd-4c67-beba-b65dc27144c8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.843209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.844693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.845463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.846181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.847593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a847910274f346d5b0320b725599b14d) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:55.848467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.851132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.862866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 334/679] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/role_assignments?user.id=a847910274f346d5b0320b725599b14d&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:55.865031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.910117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.911247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.911720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.912173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.931080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.934290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:55.957795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:55.959559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:55.961343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:55.965955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 346/680] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:55.985424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.999099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:56.097186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d650a2-82a5-40e2-b07e-77d2adf64354 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.179319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:56.180434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.180987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.181467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.198391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:56.200586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:56.218967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:56.220028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:56.221517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:56.221517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:56.221517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:56.221517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 335/681] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:56.225624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:56.227241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14d17f-bd89-48cf-9739-80f643a7f164 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.298305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:56.309435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:56.310696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.310696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.311013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.311632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:56.311931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:56.314349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:56.336667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 347/682] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:56.336667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:56.411182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31948dec-5256-465d-8590-acfc2fa666cb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.441424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:56.475794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:56.476500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.477046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.477527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.499412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:07:56.510558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:56.512492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:07:56.516813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:56.518941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 336/683] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:56.518941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:56.543420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911a65-8e73-40d5-b45b-3267955ad54a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.610497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:56.611841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.612502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.613179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.614390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:56.615090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:56.617961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:56.644333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 348/684] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:56.646080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:56.741726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355404-5773-484f-9a64-640fb4937b12 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.761525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:56.797685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:56.798759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.799322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.799823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.800842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=98a43f7e512946aab3f1d7ef7b8d4fcc) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:56.801381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:56.803228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:56.811201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 337/685] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:56 2022] GET /identity/v3/role_assignments?user.id=98a43f7e512946aab3f1d7ef7b8d4fcc&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:56.812468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:56.865223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:56.899464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140d705-4a2e-421b-a251-c033c92e8daf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.985502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53874c-8692-4106-8826-b11eff1d8eae None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:56.990266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:56.992004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.992674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.993155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.994129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:56.994666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:56.996320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.021686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 349/686] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:57.029901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:57.082123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:57.083348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:57.085300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:57.086071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:57.101427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:57.105070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:57.134078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:57.135123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:07:57.136117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:57.141764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 338/687] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:07:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:57.146669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:57.267896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fcfe9-3fb4-4ccd-9385-3376de24befa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:57.291583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:57.297889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aae50c-df16-4537-8848-b471adc55e1c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:57.300879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:57.342435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:57.343475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:57.343971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:57.344414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:57.349142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:57.350025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:57.351018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:57.351449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:57.352365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:57.352876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:57.354525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.366354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:57.369661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.380512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 339/688] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 1 05:07:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:57.387963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:57.402779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:57.404118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:57.405307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:57.405307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:57.405307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:57.405307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 350/689] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:57.413904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:57.560102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130942e1-426a-4692-b4f3-716a2de086fa None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:57.580392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6926f-797e-46aa-9527-6a0a8f279f8b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:57.602015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:57.602950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:57.603463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:57.603932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:57.604839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:57.605362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:57.607448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.622275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 351/690] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:57.630697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:57.659370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:57.660341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:57.660843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:57.661456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:57.670398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:57.745212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:57.766678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a2fc-bd71-42d8-84dc-ba92c68a69af None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:57.820539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:57.822492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.880276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:57.881440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:57.883709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:57.884232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:57.897453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:57.900467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:07:57.922616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:57.923762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:07:57.924765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:57.927421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 352/691] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:07:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:57.941351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:58.064247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 340/692] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:58.079511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:58.211771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:58.239941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac92b7-8e68-4f9b-9f4e-313f8c8ac81e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:58.257199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:58.320009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:58.320656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.320934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.321202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.322584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:58.322921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:58.324685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f947b-e172-4b89-a5a6-a2a36163400a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:58.346147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d75bae-86ba-407d-aa49-2bb32cbc9307 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:58.349855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 353/693] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:07:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:58.352319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e05e-e38c-488b-ac04-d997784653c8 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.352705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e05e-e38c-488b-ac04-d997784653c8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.352943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e05e-e38c-488b-ac04-d997784653c8 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.354635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 354/694] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:58.362370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e05e-e38c-488b-ac04-d997784653c8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:58.420361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:58.421668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.422162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.422857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.446178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:58.449357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0118cd2e-6896-43dc-9d0f-a367c91eda04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:58.481291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:58.483157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:58.484905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:58.484905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:58.484905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:58.488857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 341/695] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:58.491696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.492212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.493006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.508695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e05e-e38c-488b-ac04-d997784653c8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:58.530830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:58.533076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:58.552303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:58.553396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.554025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.554513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.584528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:58.645892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 342/696] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:58.653546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:58.666060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:58.667819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:58.793562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 355/697] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:58.805986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:58.806609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:58.870217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:58.910385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e077d35-f308-4176-bc8f-6a6c55885df3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:58.956649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:58.957300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.957576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.957846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.958514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:58.959361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:58.960801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0aa76b-cc52-445e-88cc-fd5961add32c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:58.976114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 343/698] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:58.977513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaca0b-1f24-4155-a79c-d177856dba87 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.977799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaca0b-1f24-4155-a79c-d177856dba87 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.978073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaca0b-1f24-4155-a79c-d177856dba87 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:58.984117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 344/699] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:58.985554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:58.985841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:58.986114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.011062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:59.012397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:59.019061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbcb6-8a48-41f4-9c50-558a4a5b3055 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.081197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.081847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.082499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.082499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.096153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.097693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.123328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 345/700] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:59.123328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:59.123674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:59.125262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:07:59.126883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:07:59.126883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:59.126883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:59.126883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 356/701] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:59.126883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.173270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:59.270917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9472f-eb50-4e81-b3a7-8dbe66397108 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.319311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.320185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.320655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.321121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.331904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.333609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:07:59.349054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:59.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:07:59.352409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:07:59.357947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 346/702] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:59.357947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.363615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:59.375903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d55290-f87c-424e-924a-e9f18c9f4bf5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.422395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.423754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.424244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.424791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.425643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.427370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:59.441884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:07:59.443178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:07:59.444102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:07:59.447640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 357/703] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:07:59.449062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.537194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:59.556808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763a41-f873-483d-95fa-b48bce213204 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.604951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9fd5-fb2c-4f2e-9b17-a11e7e70560a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.618901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.619800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.620275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.624455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.624455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:59.624455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.625627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.652319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 347/704] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:59.654041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.678862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.679559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.679863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.680117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.681055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:59.681536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.683959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.706203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 358/705] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:59.715278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.757657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:59.824541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288e47-e79d-4db5-a061-964b3023e222 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.870008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.870639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.870942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.871161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.871814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:07:59.872155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.874101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.880083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 348/706] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:59.880836 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.903324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:59.914208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6d038-b619-4ba3-b3d4-d3c2ce0adb95 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.964718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.965287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.965560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.965861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.978538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.980061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:07:59.997128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:00.001518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:00.003399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:00.003399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:00.003399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:00.003399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 359/707] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:00.003399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:00.039979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1e73d-39cd-4f03-93fa-e5b051277a06 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:00.084826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:00.085727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.086091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.086445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.094866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:00.096334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:00.104287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:00.108998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:00.111026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:00.112873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:00.115018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 349/708] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:00.116021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:00.168827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aa1ae-5dc7-4070-8af5-f7a7cd1205af None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:00.208346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:00.208989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.209256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.209520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.210258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=594ce9d8a0164a559fa14327d308c7b0) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:00.210555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:00.212165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff92cd-dfc5-4592-86be-395ceed36632 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:00.213521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:00.221767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 360/709] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/role_assignments?user.id=594ce9d8a0164a559fa14327d308c7b0&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:00.223323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbba8f7-cba6-480b-abf8-a46fc8b42e29 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.223760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbba8f7-cba6-480b-abf8-a46fc8b42e29 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.224139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbba8f7-cba6-480b-abf8-a46fc8b42e29 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.225934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 361/710] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:00.227337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbba8f7-cba6-480b-abf8-a46fc8b42e29 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:00.271100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123814e-1248-4209-b7c0-ceca0a0fdd94 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:00.320936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:00.321735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.322196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.322657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.323454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:00.323893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:00.325960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:00.344670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 350/711] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 1 05:08:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:00.344670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:00.447144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbba8f7-cba6-480b-abf8-a46fc8b42e29 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:00.538951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:00.539559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.539820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.540091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.540807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:00.541103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:00.542767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f272bd-e920-4a1b-9c18-b9530aa566fb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:00.545761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:00.562313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 362/712] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:00.563679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.563958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.564247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.564403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0100e5-36e5-4d57-ac1a-0dfe6a88c129 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:00.589979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:00.591958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:00.651267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:00.652668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:00.654386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:00.656010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:00.658841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:00.660012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:00.663348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:00.682534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:00.699729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 351/713] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:00.701932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:00.738487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 363/714] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:00.745727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:00.960144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156b7d8-680a-4fa4-960b-e1d082845df5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:01.009867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3dd3-32d9-4627-b772-921c999bded3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:01.050991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:01.052244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:01.052791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:01.053298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:01.054645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:01.057107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:01.091385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:01.109241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 352/715] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:08:00 2022] POST /identity/v3/users => generated 254 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:01.119307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:01.120750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:01.121517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:01.122290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:01.123998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a467a7344fff4987967c8655dc2965a1) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:01.124836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:01.127949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:01.140411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 364/716] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:00 2022] GET /identity/v3/role_assignments?user.id=a467a7344fff4987967c8655dc2965a1&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:01.188673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:01.311776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:01.408710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a381e-c0cb-4f6a-b46d-6e1931da32a0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:01.477841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:01.479447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:01.480214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:01.480908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:01.482318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:01.485220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:01.507570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:01.510090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:01.512022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:01.516539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 353/717] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:01 2022] GET /identity/v3/services/network => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:01.528794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:01.773340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824dc54-5f6a-424d-ae34-8099c81ffd14 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:01.850608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:01.851660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:01.852131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:01.852594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:01.853793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:01.854312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:01.857072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba18de-6e66-463e-94de-99b53390fba6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:01.870429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 365/718] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:01.881822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:02.037688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b1926-7d91-4e30-a192-aa0fe1f625c9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:02.073050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:02.102775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:02.103428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:02.103708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:02.104000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:02.104764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] RBAC: Adding query filter params (type=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:02.105069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:02.106628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883114-9d36-43db-8759-c1aa8af7b242 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:02.112672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 354/719] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:02.835811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ed95-038c-4f6b-ac3d-a68274e3dda3 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:02.836378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ed95-038c-4f6b-ac3d-a68274e3dda3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:02.836378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ed95-038c-4f6b-ac3d-a68274e3dda3 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:02.838187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 366/720] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:02.844855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e8572-d844-443b-8497-e7eaf9549fa4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:02.845528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e8572-d844-443b-8497-e7eaf9549fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:02.846036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e8572-d844-443b-8497-e7eaf9549fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:02.873969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c79e8572-d844-443b-8497-e7eaf9549fa4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:02.875741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c79e8572-d844-443b-8497-e7eaf9549fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:02.985606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 355/721] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:03.327950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75144736-bb7a-4f17-ad74-0e8818947801 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:03.328237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75144736-bb7a-4f17-ad74-0e8818947801 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:03.328661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75144736-bb7a-4f17-ad74-0e8818947801 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:03.330387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 367/722] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:03.336851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:03.337697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:03.337697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:03.373658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75144736-bb7a-4f17-ad74-0e8818947801 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:03.375130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:03.376437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:03.474723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 356/723] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:08:03.540107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:03.616215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75144736-bb7a-4f17-ad74-0e8818947801 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:03.657499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:03.658127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:03.658441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:03.658683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:03.659329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:03.660760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:03.695511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 368/724] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:03 2022] POST /identity/v3/services => generated 251 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:08:03.760471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:03.876977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:03.999281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73a09-3b7d-4ee2-8265-0b2432b32e5c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:04.082535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00be2-1a43-43c1-959e-83763fbd5f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:04.083695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00be2-1a43-43c1-959e-83763fbd5f73 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.084202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00be2-1a43-43c1-959e-83763fbd5f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.084779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00be2-1a43-43c1-959e-83763fbd5f73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.108293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e00be2-1a43-43c1-959e-83763fbd5f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d8e00be2-1a43-43c1-959e-83763fbd5f73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:04.119831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:04.120957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:04.122003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:04.123122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 357/725] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:04.129760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:04.301036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a17c9-5e2b-4390-acb2-43b22c3eaee2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:04.322830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b201-42d6-47e3-be03-66241b5f4244 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.325384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b201-42d6-47e3-be03-66241b5f4244 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.326853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14b201-42d6-47e3-be03-66241b5f4244 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.329358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 358/726] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:04.333836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:04.340341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.341894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.343959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.377314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:04.379551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:04.386388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:04.387403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.388045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.388798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.389738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:04.391151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:04.392843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:04.403913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 369/727] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:04.413793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:04.504183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 359/728] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:08:04.623806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad61be7-4fb2-4010-a38a-81a349b27d3a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:04.686973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:04.687551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.687830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.688101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.709783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:04.711756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4584325b-9ba6-49ac-81e5-da8241665eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:04.738725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:04.739790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:04.741400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:04.741400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:04.741400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:04.741400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 370/729] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:04.746510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:04.813703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:04.879697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2cc08-0552-4e8a-aa31-41af43238dde None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.880585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2cc08-0552-4e8a-aa31-41af43238dde None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.880772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717751-b4c0-4342-a0b0-93164cfdacfa None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:04.881571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2cc08-0552-4e8a-aa31-41af43238dde None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.885148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 371/730] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:04.892716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.893548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.894232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.923671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:04.924310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:04.924594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:04.925003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:04.925689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:04.926049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:04.927602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:04.942104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 360/731] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:04.947893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:04.962540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:04.964960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:05.055432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.056408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.066057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525216-c2a3-46ba-b35e-9ab528c8da22 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:05.114482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:05.115344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:05.115687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:05.116029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:05.127228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:05.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:05.145827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:05.146942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:05.148372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 361/732] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:05.149082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:05.150399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 372/733] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:05.154808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:05.281776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ef0d3-8104-4f25-b5a0-2cda06787c2d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:05.326260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:05.326912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:05.327190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:05.327461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:05.328216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:05.328522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:05.330248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:05.354234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 373/734] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 1 05:08:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:05.360394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:05.367499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b138-7e5b-4022-ae11-2be6acddf4cf None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:05.381769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.444576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:05.445892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:05.446390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:05.446990 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:05.470345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:05.482038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:05.484411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:05.486586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:05.488010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd2dcb-e674-493a-9749-4fb41da422a5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:05.488155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 362/735] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:05.492664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:05.516374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.526964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:05.527605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:05.527935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:05.528248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:05.610681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:05.612183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:05.645943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.687366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a894db-8b67-4dd9-8a5a-9dccb003a8a2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:05.741368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:05.742501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:05.743945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:05.744446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:05.746235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:05.747070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:05.752356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:05.778830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 363/736] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:05.781827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:05.809830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 374/737] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:05.811361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:05.948405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06905-2645-47d4-8449-209a9ad4d7d0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:05.957280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.970739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.992115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:05.993352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:05.993883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:05.994367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.007134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.009348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.019691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d1c4f-2f01-485e-b489-c89d592a5df4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:06.026971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:06.028074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:06.029585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:06.029585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:06.029585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:06.035112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 375/738] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:06.035112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.084479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972a5ff-b4e4-4de4-987d-a5ebcabc6c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.085535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972a5ff-b4e4-4de4-987d-a5ebcabc6c5b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.085988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972a5ff-b4e4-4de4-987d-a5ebcabc6c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.086458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972a5ff-b4e4-4de4-987d-a5ebcabc6c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.107536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972a5ff-b4e4-4de4-987d-a5ebcabc6c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a972a5ff-b4e4-4de4-987d-a5ebcabc6c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:06.118501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:06.119560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:08:06.120478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:06.121976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 364/739] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:06.123060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b1817-42f6-4d4b-9fc6-1df7eceb9510 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.123474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b1817-42f6-4d4b-9fc6-1df7eceb9510 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.124044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b1817-42f6-4d4b-9fc6-1df7eceb9510 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.126241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 365/740] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:06.127552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b1817-42f6-4d4b-9fc6-1df7eceb9510 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.162886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a4e5-97ef-4c47-ba66-88b8319e8e0e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.214683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.215247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.215707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.216371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.231615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.233955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:06.252293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:06.253803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:06.255569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:06.255569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:06.255569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:06.256827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 376/741] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:06.258257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.299110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:06.300333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b1817-42f6-4d4b-9fc6-1df7eceb9510 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.352031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:06.363095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.364016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.364485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.364962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.365772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:06.366259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.368669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dd274-3519-4ca8-83f5-a13baee9d3aa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.395607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 366/742] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:06.395607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.395607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.395607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.420862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:06.422643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:06.439955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141aef8-59db-4588-ac04-2ca658912e7f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.480120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.480654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.481101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.481362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.482081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:06.482387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.483795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.502044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 377/743] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:06.502044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.548660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 367/744] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:06.548660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.626930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:06.650098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32849dc-4a4f-4a55-96c6-4866ae695097 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.695437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.696162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.696486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.696776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.697505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:06.697694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.699117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.699969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932e6a-59da-4563-8a2e-81ace87bb353 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.721705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 378/745] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:06.721705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.733673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:06.755709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.756367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.756671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.756931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.765941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.767469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8c52b642-bf59-4683-aed3-f3f7242cbb01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:06.783217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:06.785478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:08:06.787633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:06.789820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 368/746] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:06.791311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141d1c-27ec-4e14-ab09-9f92805cc457 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.791604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141d1c-27ec-4e14-ab09-9f92805cc457 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.791884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141d1c-27ec-4e14-ab09-9f92805cc457 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.793313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 369/747] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:06.794624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141d1c-27ec-4e14-ab09-9f92805cc457 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.866586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a45d6-f0d9-482e-b460-3c861aceac28 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.907485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.908136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.908411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.908720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.921739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.924123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:06.925733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141d1c-27ec-4e14-ab09-9f92805cc457 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:06.927199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:06.943778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:06.945111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:06.947483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:06.947483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:06.947483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:06.947483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 379/748] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:06.947483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:06.976443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:06.977365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.977741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.978133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.987865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:06.989406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a4fe7e78-f1ba-4ca2-bdf1-294fec294b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:07.003542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:07.005105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 370/749] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.006857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.008376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.027311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:07.028699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:07.075421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:07.080584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30e4e-4274-41d6-bdd4-0265b206b912 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.125635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 371/750] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:07.126526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.133559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.134593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.135059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.135543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.137038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:07.137583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.140454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.175108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 380/751] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:07.176674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.267163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:07.298686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd584fe1-e74c-421d-a530-a2b4fe72a038 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.347838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231e27b-cb51-46cf-9891-188db7af20c8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.349185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.350155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.350613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.351066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.352056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.354342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.388720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 372/752] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:07 2022] POST /identity/v3/services => generated 240 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:07.388720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.454940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:07.470081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.472760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.473259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.473875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.474986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:07.475494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.478331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.496418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 381/753] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:07.497475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.611864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1987a-a771-44e3-9ad1-2b7208cc3a5f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.647128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807c8b-089f-4d8e-80fb-40ad7b433d53 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.662426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:07.674728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.675753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.676229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.676731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.677987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:07.678506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.681267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.692889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.693550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.693837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.694125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.705495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 373/754] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:07.707056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.708666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.713805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:07.725890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:07.728420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:07.730251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:07.730251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:07.730251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:07.730251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 382/755] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:07.730251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.849936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:07.868198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b5e7-6b0c-4ed8-b65f-6d3190bf4dab None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.868992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e953c37-f860-4a9c-b139-0ce65c1021d5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.907973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.908641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.908956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.909219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.918050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.921938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:07.933206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:07.934431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:07.935436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:07.940881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.941540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 383/756] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:07.942061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.942498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.942918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.943064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.943846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.946211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:07.961183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:07.962380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:07.964839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 374/757] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:07.967273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.986321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.093354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b71b-c92a-4371-a393-07f1250ab577 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.123888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50d90d-c802-4ece-a416-8e4b87a58e02 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.140955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.141904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.142366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.142820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.143920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=594ce9d8a0164a559fa14327d308c7b0) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:08.144355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.146369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.153977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 384/758] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/role_assignments?user.id=594ce9d8a0164a559fa14327d308c7b0&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:08.162752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.170320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.171162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.172749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.172749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.172749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:08.173366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.174943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.191417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 375/759] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:08.193006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.213529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.316839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.352972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765994e0-c7c7-4ae7-96fd-d732b60e96b6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.370524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732cc79-14d3-4bf3-961c-452560fc4336 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.416553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.417458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.417696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.418085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.418888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:08.419294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.421661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.428136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.429625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.430325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.431020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.432480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:08.432792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 376/760] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:08.433283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.433835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.435717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.462587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 385/761] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:08.463938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.539166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.566368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bace-8213-4c59-80b5-036a436d0042 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.588966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd9b9a-e029-489b-ba73-8c6f723b74d2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.611124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.611795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.612099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.612496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.621049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.622758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:08.636440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:08.637584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:08.638516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:08.638961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.639055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 377/762] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:08.639055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.640563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.641094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.641736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.642727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:08.643242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.644997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.652934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 386/763] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:08.654281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.664555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.787420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbdc8e-8d39-489b-b086-8968ee9aa15b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.787926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972d71-6866-4040-a9eb-89c6c9dd75ed None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.826626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.827257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.827536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.827844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.828372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.829191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.829641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.830169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.831123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:08.831653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.833576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.837531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.855621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 387/764] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:08.856946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.907000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.908484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.938314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.990771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325968-21f7-4aa2-aa4b-a881e722201f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:09.042476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 378/765] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:09.042476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:09.056478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:09.057735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.058860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.059431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.060966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] RBAC: Adding query filter params (interface=public, service_id=bbcb85465bc14a5597480e0c009374ca, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:09.061732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:09.063880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:09.082414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 388/766] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/endpoints?service_id=bbcb85465bc14a5597480e0c009374ca&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:09.083192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:09.094179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:09.164008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bec3b3-403b-45b9-ba82-c6dd21776a3b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:09.203092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:09.203955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.204329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.205125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a467a7344fff4987967c8655dc2965a1/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.206968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=a467a7344fff4987967c8655dc2965a1, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:09.208763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:09.216987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5afe-5cee-42d8-ad4e-0ed734bd1264 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:09.245258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 379/767] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:08:09 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a467a7344fff4987967c8655dc2965a1/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:08:09.245258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:09.274034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:09.287809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9e112-0274-4689-8870-860474afb4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:09.288656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9e112-0274-4689-8870-860474afb4df None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.289042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9e112-0274-4689-8870-860474afb4df None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.289406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9e112-0274-4689-8870-860474afb4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.307185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9e112-0274-4689-8870-860474afb4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:09.310926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9e112-0274-4689-8870-860474afb4df None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-84d9e112-0274-4689-8870-860474afb4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:09.343676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:09.345371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:09.346554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:09.346554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:09.346554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:09.350383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 389/768] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:09.354635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9e112-0274-4689-8870-860474afb4df None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:09.475530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:09.484000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24aac5-2c64-4000-a933-bd51c7185f25 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:09.540226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:09.541319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.542421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.543092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.544499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:09.545868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9e112-0274-4689-8870-860474afb4df None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:09.546455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:09.555389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 380/769] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:09 2022] GET /identity/v3/services => generated 772 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:09.593776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:09.594417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.594689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.594955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.595619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:09.595919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:09.597405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:09.616912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 390/770] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:09.623441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:09.752643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a43d7-fd7f-463f-adf2-9a9acff19500 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:09.805643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:09.806329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.806614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.806889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.815798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:09.817429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0171c9d6-abf1-4700-948d-7b6b964eac30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:09.839602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:09.840698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:09.841767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 381/771] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:09.849018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:09.922564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:09.925660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903fb32-e855-4058-8334-bedaf2c1339d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.925949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903fb32-e855-4058-8334-bedaf2c1339d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.926311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903fb32-e855-4058-8334-bedaf2c1339d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.927840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 382/772] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:09.934257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:09.934604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:09.934812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:09.964494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:09.966718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:09.993314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:10.031745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba8325-9855-4d5d-8c2f-d3af94ed7328 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:10.054219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 383/773] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:10.113482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:10.114422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:10.114887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:10.115363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:10.116684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:10.117208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:10.119924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:10.153656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 391/774] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:10.159734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:10.329474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b48e-53f6-4bad-ae81-4fc7b8044a6a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:10.385328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:10.385880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:10.386155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:10.386423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:10.386801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:10.387766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=284d5528b1b84bd19e773ff09ee196ae) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:10.387766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:10.389356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:10.396130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 384/775] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:10 2022] GET /identity/v3/role_assignments?user.id=284d5528b1b84bd19e773ff09ee196ae&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:10.580990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15460d3f-1b60-4df3-82f5-4d59cd047136 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:10.582833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:10.630213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:10.630883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:10.631158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:10.631430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] PATH_INFO: `/v3/services/network` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:10.632039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:10.633853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e27dd390-966e-4b05-94f6-270ec647f844 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:10.644299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:10.645412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:10.646282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 392/776] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:10 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:10.657980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:10.703520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:10.788858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55bfbc-4cf6-4b18-91c3-ba1794e3a53f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:10.789313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55bfbc-4cf6-4b18-91c3-ba1794e3a53f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:10.789775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55bfbc-4cf6-4b18-91c3-ba1794e3a53f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:10.792133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 393/777] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:10.801699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:10.802164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:10.802629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:10.836163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:10.838257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:10.954943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 394/778] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:10.992544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60eeec-234b-4f43-be04-52c6980ec86e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:11.088032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:11.088979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.089403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.089812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.090892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] RBAC: Adding query filter params (name=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:11.091413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:11.093778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:11.108216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 385/779] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:11.117149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:11.329556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:11.339818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c2e5-1768-4b9f-a716-cc752f4676b5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:11.350110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:11.449050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:11.450942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.451431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.451914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.453175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] RBAC: Adding query filter params (type=network) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:11.453709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:11.456324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:11.471223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 395/780] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:11.480702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:11.647752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:11.705554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092cac5-d4a5-4c33-ae71-0c1b32567351 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:11.733645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9ea4-b851-4b0e-b880-0089279a4770 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:11.760560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:11.761223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.761500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.761771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.762564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] RBAC: Adding query filter params (interface=public, service_id=6bc8ae586b71454ba9eb2b698ffa4919, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:11.762875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:11.764350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde3b9-d93e-4476-89b6-10ea81d9d25c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:11.771339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 396/781] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:11 2022] GET /identity/v3/endpoints?service_id=6bc8ae586b71454ba9eb2b698ffa4919&interface=public®ion_id=RegionOne => generated 194 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:11.772816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646443-22e6-4626-bb9d-cc7a192c9780 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.773361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646443-22e6-4626-bb9d-cc7a192c9780 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.773642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646443-22e6-4626-bb9d-cc7a192c9780 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.780368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 397/782] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:11.781465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3646443-22e6-4626-bb9d-cc7a192c9780 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:11.812355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d488f-fa8a-4fe4-a018-4101a1a81dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:11.813493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d488f-fa8a-4fe4-a018-4101a1a81dce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.813986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d488f-fa8a-4fe4-a018-4101a1a81dce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.814098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:11.815029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d488f-fa8a-4fe4-a018-4101a1a81dce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.839788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d488f-fa8a-4fe4-a018-4101a1a81dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3e0d488f-fa8a-4fe4-a018-4101a1a81dce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:11.851311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:11.853318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:11.860835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 386/783] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 505 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:11.863665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.864120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.864590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.900460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:11.903082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:11.911068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3646443-22e6-4626-bb9d-cc7a192c9780 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:11.961648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:11.962291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:11.962577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:11.962868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:11.968001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:11.968001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:11.972247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 398/784] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:11 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:11.973260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.024936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 387/785] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:12.145973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:12.162061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedde94c-d8b3-4f65-b8a0-b1d4950c723c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:12.217658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:12.218740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.219225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.219724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.220715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:12.221247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:12.222889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:12.234824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 399/786] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:12.240573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.323944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:12.359652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a7982-9c09-4429-a3cb-4bdf4c08330f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:12.403034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:12.404056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.404466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.404873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.417699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:12.419349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:12.429057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:12.438193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:12.439414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:12.440462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:12.440462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:12.440462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:12.445750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 388/787] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:12.450897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.592235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263e0a-6e61-4924-96ff-95833a7c5091 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:12.619368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:12.636495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:12.637575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.637826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.638091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.638759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:12.639063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:12.640485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:12.644638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905072c8-6d64-4212-982e-41d6d216154a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:12.656119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 389/788] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:12.663149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.783034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62cc6-da58-4fcd-a583-934acf49d7e2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:12.783806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:12.784889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.785377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.785834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.824513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:12.825280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.825665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.825943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.834565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:12.836170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:12.837365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:12.848444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:12.849517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:12.850374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:12.855951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 400/789] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:12.859318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:12.861489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:08:12.863819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:12.865114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.868706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 390/790] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:12.872166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.888487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:12.964996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.098421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c6801-be57-465e-b961-6b008cc77673 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.101928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b014a-b09d-4c59-95e3-9b13e747eade None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.157256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.158012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.158292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.160037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.160831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:13.161141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.162656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.179264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.179911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.180193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.180469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.181259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:13.181571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.183063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.196832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 401/791] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:13.203389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:13.206606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 391/792] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:13.212466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:13.347550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.386539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b941a4-5016-4576-84bb-2a5b36514059 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.430402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.431064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.431345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.431616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.444231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.445906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1f483d66-e9ee-49c5-90c9-70e405973098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:13.463396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:13.464442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:13.465936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:13.465936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:13.465936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:13.465936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 402/793] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:13.467454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596becec-8556-444e-9ae1-4371ef7bf7da None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.467454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596becec-8556-444e-9ae1-4371ef7bf7da None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.467454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596becec-8556-444e-9ae1-4371ef7bf7da None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.468766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 403/794] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:13.473361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596becec-8556-444e-9ae1-4371ef7bf7da None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:13.485829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.489050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537addd3-faba-40e8-b562-6f0df0397dea None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.532318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.533112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.533465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.533807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.546506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.548050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fda4e03d-c03a-4c88-b461-873d115de72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:13.564828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:13.566086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:13.567227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:13.567227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:13.567227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:13.568173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 392/795] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:13.569907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35ea3-a366-4cc0-b0f6-6ecc6f429dd3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.570349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35ea3-a366-4cc0-b0f6-6ecc6f429dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.570871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35ea3-a366-4cc0-b0f6-6ecc6f429dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.597669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d1d35ea3-a366-4cc0-b0f6-6ecc6f429dd3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:13.599611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d1d35ea3-a366-4cc0-b0f6-6ecc6f429dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:13.608386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596becec-8556-444e-9ae1-4371ef7bf7da None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.638609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.654628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.655312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.655605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.655801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.656884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:13.657449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.659887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.688928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 404/796] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:13.690716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:13.716590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 393/797] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:13.718340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941e75-5856-4210-8343-a66882dd0ddc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.718826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941e75-5856-4210-8343-a66882dd0ddc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.719308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941e75-5856-4210-8343-a66882dd0ddc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.720891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 394/798] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:13.721871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941e75-5856-4210-8343-a66882dd0ddc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:13.825409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59199-b7c5-48e9-b6c3-f36c380a7a78 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.865889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.867073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.868016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.868138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.868314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.869187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:13.870092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.871267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4032-1a40-45e9-beac-1dfbec984055 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.886368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 405/799] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:13.888049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.888399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.888761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.892461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941e75-5856-4210-8343-a66882dd0ddc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:13.917697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:13.922115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:13.943579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:13.945191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:13.945721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:13.946202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:13.958784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:13.961370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:13.972522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:13.978950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:13.980045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:08:13.981972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:13.984671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 395/800] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:08:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:13.985994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.016815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 406/801] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:14.018180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.123117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed8ee-f339-4fa8-8635-a93018ffacc9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.180333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.181544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.182092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.182578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.208340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:14.213140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:14.238215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:14.239258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:14.240186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 396/802] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:14.241418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.247966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:14.280728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58548f-979d-4147-9498-4ceabdeb2754 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.352234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.353017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.353380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.353754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.354537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:14.354840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:14.356404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:14.395149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b06-d988-4e91-8215-aeda2e269c1a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.444272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.445184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.445565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.445940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.446680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:14.448279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:14.459413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:14.461692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:08:14.463495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:14.468018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 397/803] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:14.469120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.510214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 407/804] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:14.513454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.555929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:14.563464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:14.623285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f26e6-41ac-4dbf-883e-c4211b1770c9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.645930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f29b03-9fd5-402b-8b51-eb1297a5a24f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.680374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.681361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.681815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.682125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.682916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:14.683232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:14.685240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:14.690084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.690945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.691080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.691337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.700189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 398/805] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:14.701399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.714726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:14.719827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:14.721887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 408/806] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:14.723671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.841429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd66b-5eed-4637-a1c0-034a242bddea None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.844404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:14.859291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1da250-2f7f-4d15-a203-62067d50674c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.883605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:14.897057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.897586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.897862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.898130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.898774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:14.899069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:14.900479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:14.904126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830f98a-f3e1-4841-ba23-785369ee10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.904789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f98a-f3e1-4841-ba23-785369ee10b4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.905068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f98a-f3e1-4841-ba23-785369ee10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.905336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f98a-f3e1-4841-ba23-785369ee10b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.906279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 399/807] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:14.907559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.012030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830f98a-f3e1-4841-ba23-785369ee10b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.013553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830f98a-f3e1-4841-ba23-785369ee10b4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.054160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da39a2-6fb4-471b-880f-687a51f6cdd0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.092778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.093461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.093732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.094010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/594ce9d8a0164a559fa14327d308c7b0/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.096020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=594ce9d8a0164a559fa14327d308c7b0, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.097574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.114236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 400/808] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:08:14 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/594ce9d8a0164a559fa14327d308c7b0/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:08:15.115606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.146315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:15.163124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 409/809] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:15.166361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e56f1-72ee-4f24-aec5-80c7a2f3ece6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.166840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e56f1-72ee-4f24-aec5-80c7a2f3ece6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.167310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e56f1-72ee-4f24-aec5-80c7a2f3ece6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.172067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 410/810] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:15.173528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e56f1-72ee-4f24-aec5-80c7a2f3ece6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.189804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:15.267774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd7cef-406a-49e6-a630-43432c7ccad8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.316532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e56f1-72ee-4f24-aec5-80c7a2f3ece6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.327824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.328472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.329128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.329822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.330655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:15.330965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.333254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.347903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 401/811] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:15.347903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.362533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.363164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.363438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.363738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.364376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:15.364732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.366143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbc559-f354-4c44-8796-724249da9b89 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.371549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 411/812] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:15.373440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.373607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.373817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.396197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:15.397590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:15.485170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:15.508657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d336ec-c8fa-452e-8e8b-f65a40eda4e3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.515334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 412/813] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:15.517429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.532076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:15.577674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.579353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.580148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.580918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.603325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.607020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:15.636220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:15.638243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:15.640022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:15.640022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:15.640022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:15.640338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536c90-af55-4efe-a6bb-da5bf3c9c1ab None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.645626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 402/814] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:15.647661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.679834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.680490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.680799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.681066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.693042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.694532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:15.710979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:15.712822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:15.716370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:15.716370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:15.716370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:15.716370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 413/815] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:15.716370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.760160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:15.784202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbe0c2-acc8-4ebb-a440-b7a7bea9bda7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.825974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.826611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.826888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.827160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.827844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.829424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.833052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063275-161d-45ed-9356-8aaffee625b9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:15.861088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 403/816] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:15.862573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:15.881541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:15.882162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:15.882411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:15.883021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:15.883677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:15.883970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:15.885466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:15.892129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:15.899900 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 414/817] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:15.908195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.021620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91702-b3a9-4733-a83b-284fa95315aa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.064426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.065100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.065368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.065642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.066417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:16.066721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.068349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.083534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 404/818] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:16.084505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.086309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:16.094775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3168c-72d6-45be-9972-a2bab33d14ce None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.139146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.139920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.140288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.140662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.148599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.150302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:16.164051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:16.165107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:16.166033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 415/819] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:16.166542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.223210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:16.249795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20927d5-a195-4baa-a083-afbced6eebb9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.321162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4bea-ca98-4ae2-8507-ec84b3bc0675 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.325788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.326042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.326336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.326792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] PATH_INFO: `/v3/services/network` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.327844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.330466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:16.348135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:16.349367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:08:16.350320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:16.351553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 405/820] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/services/network => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:16.352563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.375931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.377150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.377686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.378191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.389338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.391316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:16.405101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:16.406159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:16.407411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:16.410384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 416/821] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:16.411645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.441452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:16.561416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceb32f-118d-4fe3-9ea8-8ecb41f86375 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.582970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0afe1-0d27-40f4-916a-9f2baeeef14d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.626227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.627257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.627721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.628166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.629274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:16.629755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.632225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.648764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 417/822] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:16.649846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.651829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.653243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.654253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.654696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.655989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:16.656511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.659429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.688457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 406/823] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:16.690098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.713061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:16.780401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:16.824524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7d089-3fda-4cc4-8023-34011edecbd8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.843324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c80702-4809-4af9-b1ec-293558053f4a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:16.891052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.891829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.892146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.892480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.893444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] RBAC: Adding query filter params (type=network) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:16.893583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.895092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.896096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:16.897539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:16.898354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:16.899132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:16.900941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:16.901334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 407/824] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:16.902144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:16.902827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.905969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:16.957216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 418/825] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:16.959372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:16.986838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:17.031528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6cc41-88a5-4690-9e16-4aaed8739abb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:17.077404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:17.078033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.078420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.078742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.079505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a467a7344fff4987967c8655dc2965a1) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:17.079802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:17.081396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:17.090108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 408/826] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:16 2022] GET /identity/v3/role_assignments?user.id=a467a7344fff4987967c8655dc2965a1&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:17.091451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:17.180148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04022c20-f25f-4d17-980b-1b309cb9e596 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:17.227870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:17.228491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.228806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.229072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.229784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:17.232166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:17.240112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:17.266432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 419/827] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:17.287952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa745bdd-87af-4e3e-bcfb-c3b6acebcfd8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:17.351830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:17.374145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:17.375222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.375707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.376175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.399397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:17.402087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:17.432458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:17.433727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:17.435129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:17.435129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:17.435129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:17.435332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 409/828] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:17.443847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:17.578496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129adbd-bfab-45ea-aeb9-c210518e22a6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:17.630942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:17.632052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.632959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.633471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.634153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:17.634454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:17.635891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fe7cd-52a2-4d2f-8b7d-3b1a79898639 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:17.653603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 420/829] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:17.663523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:17.772528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fff7e4-f9b1-4164-934e-c88ba2454682 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.772882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fff7e4-f9b1-4164-934e-c88ba2454682 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.773331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fff7e4-f9b1-4164-934e-c88ba2454682 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.774783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 421/830] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:17.789292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.789948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.790382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.832293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:17.835633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:17.858869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b624e-0f9b-4e99-9c1a-533d37f3c1bf None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:17.917103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:17.927840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:17.928379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:17.928867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:17.930635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:17.942624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:17.945633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:17.967018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:17.969160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:17.971402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:17.976931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 410/831] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:17.978737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:17.988882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 422/832] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:18.068725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:18.185868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067475-e3a0-4ec7-9c68-c8a5b591d30f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:18.255138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:18.256150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.256651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.257384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.259006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:18.259631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:18.262678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:18.287602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 411/833] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:18.296508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:18.491576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924b6b0-837b-4f59-a73c-95eba6be9a2a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:18.502887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:18.562423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112da99-25b3-40cd-bed1-af7dcaed5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:18.564029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112da99-25b3-40cd-bed1-af7dcaed5c81 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.564835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112da99-25b3-40cd-bed1-af7dcaed5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.565584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112da99-25b3-40cd-bed1-af7dcaed5c81 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/284d5528b1b84bd19e773ff09ee196ae/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.594377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112da99-25b3-40cd-bed1-af7dcaed5c81 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=284d5528b1b84bd19e773ff09ee196ae, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:18.597640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112da99-25b3-40cd-bed1-af7dcaed5c81 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:18.627236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 423/834] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:08:18 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/284d5528b1b84bd19e773ff09ee196ae/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:08:18.699714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:18.706097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfcefa-9c64-482a-9866-cc7432afbfde None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:18.744063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2508436-6388-49a4-8fbb-86b4530f6ae8 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.744376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2508436-6388-49a4-8fbb-86b4530f6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.744713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2508436-6388-49a4-8fbb-86b4530f6ae8 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.746494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 424/835] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:18.752552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.752873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.753165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.774801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:18.776294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:18.778896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:18.780058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.780648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.781095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.802380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:18.811014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:18.813438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:18.814434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 412/836] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:18.826254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:18.843593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:18.941541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 425/837] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:19.042998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083bb6-fdd3-468e-9aae-95a023c37876 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:19.110979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:19.112573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.113389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.114155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.115663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:19.116521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:19.119444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:19.138354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 413/838] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:19.148062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:19.280362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:19.329622 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef83dd-85cb-4e35-8bd3-389fceac73c9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:19.345625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:19.383339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:19.385101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.386411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.387687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.410239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:19.413982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:19.446342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:19.447449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:19.448363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:19.448363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:19.448363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:19.456848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 426/839] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:19.459716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:19.492948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f467-5a60-48c5-9cc7-8dd4d2d43d34 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:19.517058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:19.555503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:19.556581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.557025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.557417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.558366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:19.560202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ea503928-4682-48d0-9f55-77e47e2a5dce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:19.569876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:19.571220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:19.572376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:19.576401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 414/840] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:19.577942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f5ae2-17ac-42cd-8448-d2d3eb6280ba None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.578225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f5ae2-17ac-42cd-8448-d2d3eb6280ba None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.578507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f5ae2-17ac-42cd-8448-d2d3eb6280ba None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.580138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 415/841] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:19.580672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f5ae2-17ac-42cd-8448-d2d3eb6280ba None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:19.682165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c9deb-d3e9-4f34-9bae-3985630fb48d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:19.712234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:19.733524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f5ae2-17ac-42cd-8448-d2d3eb6280ba None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:19.744985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:19.746072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.746550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.747020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.748148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:19.748710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:19.751245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10faa2d-69a1-437a-a1e4-ad29fa6a04e3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:19.781111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 427/842] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:19.783243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.783769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.784158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.785146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:19.786120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:19.786571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:19.787010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:19.788066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:19.788536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:19.791129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:19.810218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 416/843] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:19.810218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:19.813707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:19.815907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:19.908716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 428/844] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:19.908716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:19.913889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:20.006019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80163a95-d57b-4b73-aec1-a0e32a3ff56a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.053672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.055610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.056130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.056607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.067755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.069979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.083906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7eafb-7b23-4a98-8238-a8d9c53df132 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:20.085714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:20.086675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:08:20.087658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:20.090434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 417/845] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:20.099776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:20.126930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:20.159797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.160949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.161461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.162124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.163338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:20.163987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.166701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.181226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 429/846] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:20.277716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:20.310732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48989c3-ec59-4faf-96bc-954ae2fcc9c1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.354368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.355002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.355690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.356113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.357249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:20.357658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.359189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.366308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:20.384720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 418/847] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Sep 1 05:08:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:20.397968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:20.422417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd87a4-63c7-4cc9-8ef5-1bc7597266a7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.481270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.481946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.482222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.482500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.483110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.485882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:20.498525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:20.499584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:20.500528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 430/848] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Sep 1 05:08:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:20.506227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:20.507865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:20.568973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b34f43-89cb-40e1-9245-9609dd59d78f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.625502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.626253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.626594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.627221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.639281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ca886-0fa5-419e-9bf6-a9b3aebedbf8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.677248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:20.684818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.685810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.686311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.686754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.687572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:20.688079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.690781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.702729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 431/849] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:20.704071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:20.731486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.733558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.813132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:20.857011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98978d34-28e9-4b55-9587-579f13a2df40 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:20.861765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 419/850] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:20.867906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:20.914080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:20.915608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.916093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.916556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.917480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:20.918141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:20.919857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:20.932969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 432/851] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:21.002543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b51ff-85f2-4e10-89a5-9a2e21fd7eab None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:21.047820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:21.048602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.050587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.051939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.075352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:21.080013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:21.113837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:21.115740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:21.117423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:21.117423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:21.117423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:21.123437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 420/852] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:21.129510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:21.251587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:21.308151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475771-6cf6-4eb9-878d-5ba11d41ac23 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:21.351022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:21.351921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.352380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.352839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.353675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:21.354123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:21.355842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:21.372342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 433/853] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:21.378619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:21.409274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:21.506365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2e3b-d712-40f0-bff2-998a7eb95f0f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:21.549946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:21.550610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.550884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.551142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.561268 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:21.562850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:21.577124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:21.579155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:21.581208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:21.588657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 421/854] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:21.594692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:21.741266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a5a59-0eed-45f4-bebc-5ecc0c49883e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:21.766816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:21.785035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:21.785738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.786020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.786294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.787138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:21.787707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:21.789709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff97e-fd5c-40ea-9e17-589f31603a9f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:21.804229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 434/855] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:21.814864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:21.882817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04598658-76fa-475e-9729-0765633526c6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.883120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04598658-76fa-475e-9729-0765633526c6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.883466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04598658-76fa-475e-9729-0765633526c6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.884790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 435/856] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:21.894435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.895098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.895713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.926998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:21.929655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:21.954899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:21.985072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e8f4-60a3-4da1-b8da-169e221e1dff None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:22.033015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:22.033914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:22.034340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:22.034776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:22.036024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=594ce9d8a0164a559fa14327d308c7b0) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:22.036508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:22.038399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:22.048488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 422/857] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:21 2022] GET /identity/v3/role_assignments?user.id=594ce9d8a0164a559fa14327d308c7b0&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:22.068858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 436/858] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:22.540837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:22.670952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc769c-4b02-4add-bcb0-2ad6b8d072e8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:22.712999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:22.714072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:22.714641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:22.715872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:22.728772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:22.735363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:22.736408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:08:22.737314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:22.740191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 423/859] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:22.750217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:22.891380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe39fb1-b194-4c10-bfc2-6012fa379129 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:22.906571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:22.936433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:22.938037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:22.938519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:22.938989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:22.939902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:22.940424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:22.942600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85e796-c137-4502-81b9-d33f0254cc7d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:22.954933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 437/860] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:22.963893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:22.971476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:23.001303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa0df-44c4-4c6b-9f1f-4f756efe4615 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.001638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa0df-44c4-4c6b-9f1f-4f756efe4615 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.001842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa0df-44c4-4c6b-9f1f-4f756efe4615 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.003538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 438/861] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:23.009534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.009870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.010082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.030488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:23.031711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:23.119781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1e0c7-178a-4a22-8a2c-0f5afdb80186 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:23.127482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 439/862] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:23.163003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:23.164036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.164553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.165100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.178900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:23.180823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:23.198160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:23.199384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:23.201090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:23.201090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:23.201090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:23.203529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 424/863] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:23.216670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:23.344670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4466-521d-41f2-a8b3-e249bd4e5e64 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:23.346817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:23.391247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:23.391886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.392161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.392427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.393141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:23.393445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:23.394895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:23.409785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 440/864] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:23.418834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:23.425208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:23.501394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:23.587745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1cde8-d41b-4842-bbdc-e9e0c3fffac6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:23.597695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cb60d-b556-4723-a240-21b3a2d5293f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:23.638868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:23.639976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.640772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.641427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.653218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:23.655237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:23.665734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9690-5757-4ba7-97f1-7a2f8b1c24b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:23.666884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9690-5757-4ba7-97f1-7a2f8b1c24b7 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.667436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9690-5757-4ba7-97f1-7a2f8b1c24b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.668191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9690-5757-4ba7-97f1-7a2f8b1c24b7 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.669538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9690-5757-4ba7-97f1-7a2f8b1c24b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:23.671540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:23.672481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:23.673496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:23.674059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9690-5757-4ba7-97f1-7a2f8b1c24b7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:23.676328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 425/865] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:08:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:23.686065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:23.701844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 441/866] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:23 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:23.703717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79f79-3870-4d94-af34-6471390d9242 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.704226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79f79-3870-4d94-af34-6471390d9242 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.705489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79f79-3870-4d94-af34-6471390d9242 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.707806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 442/867] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:23.714329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.714734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.714979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.736254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:23.737615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:23.762914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:23.899495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 443/868] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:23.927958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da09d-feb9-4b47-b829-e09282f757c2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:23.950951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:23.978074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:23.978763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:23.979040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:23.979309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:23.980107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:23.980451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:23.982162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:24.005238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 426/869] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 1 05:08:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:24.015897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:24.241980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c3d02-614f-4ff0-85de-38f12b8c58c7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:24.310232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:24.311283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:24.311744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:24.312204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:24.346893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:24.405396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:24.406888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:24.424022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:24.582351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 444/870] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:24 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:24.588518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:24.613475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d800d-90af-4b7d-84c6-6ca503dc8874 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:24.658724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:24.659770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:24.660249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:24.660798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:24.661887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:24.663604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:24.689148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 427/871] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:24 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:08:24.710324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:24.803011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfe796-e509-4fe7-b087-ac6654cc16c6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:24.881950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:24.883927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:24.884730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:24.885431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:24.908012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:24.911042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-c0a19b46-bd02-4aaf-8d24-e66f6ea8474a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:24.943180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:24.944942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:24.946644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:24.946644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:24.946644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:24.950101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 445/872] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:24.959194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:25.019413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4864564-b65f-4715-9c8e-8d44cbbe7390 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:25.020132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4864564-b65f-4715-9c8e-8d44cbbe7390 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:25.020132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4864564-b65f-4715-9c8e-8d44cbbe7390 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:25.021692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 446/873] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:25.028007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:25.028277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:25.028546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:25.032759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:25.057579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:25.060798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:25.165765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff789b93-f6b7-421c-be89-9b0152a1515b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:25.180078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 447/874] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:25.209492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:25.210192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:25.210478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:25.210749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:25.211436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:25.211742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:25.213272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:25.228890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 428/875] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:25.238098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:25.293102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:25.450836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167ed2d-775d-4a51-8d78-800769d242a6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:25.519767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:25.521185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:25.521792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:25.522478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:25.536268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:25.539362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:25.561965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:25.563935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:25.565932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:25.571903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 448/876] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:25.582923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:25.623231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:25.776680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:25.788651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:25.792939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83495-87dc-448a-bb65-9b3d82ba3a5e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:25.820059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eb987-76b4-476c-88c6-75c282cf7581 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:25.864432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:25.865531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:25.866050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:25.866513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:25.867914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:25.868430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:25.871292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:25.891259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:25.892886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:25.893605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:25.894343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:25.895610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:25.896686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 429/877] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:25.902857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:25.904204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:25.926816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:25.928818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:25.930553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:25.934547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 449/878] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:25.940404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:26.092541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb93ac0-4f5c-44fd-b106-c83481661f8c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:26.126548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743bc08-0ce1-4bdb-8313-4582f4f64583 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:26.131242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:26.131877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:26.132144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:26.132793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:26.133448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:26.133747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:26.135732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:26.145386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 450/879] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:26.147328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:26.164824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:26.195286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:26.196016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:26.196304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:26.196556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:26.197566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=284d5528b1b84bd19e773ff09ee196ae) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:26.197883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:26.200644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8a1f1-812d-4e81-9d4e-16a5c328725b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:26.210713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 430/880] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:25 2022] GET /identity/v3/role_assignments?user.id=284d5528b1b84bd19e773ff09ee196ae&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:26.367741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b30b9b-fe08-4f70-b6f1-69204b865d78 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:26.426187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:26.426828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:26.427107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:26.427390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:26.428024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:26.428331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:26.429835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef4ce6-1d0a-4f2c-a6d7-b0543164c009 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:26.436612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 451/881] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:26.755755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7f427-ba02-4790-bd01-b3d0ba7af7e7 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:26.756283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7f427-ba02-4790-bd01-b3d0ba7af7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:26.756601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7f427-ba02-4790-bd01-b3d0ba7af7e7 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:26.760108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 431/882] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:26.770063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:26.770548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:26.771036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:26.804284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:26.806587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:26.895281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 452/883] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:27.217785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7f427-ba02-4790-bd01-b3d0ba7af7e7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:27.256961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:27.433659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7f427-ba02-4790-bd01-b3d0ba7af7e7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:27.509558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:27.511736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:27.512603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:27.513337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:27.514543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:27.517464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:27.535844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:27.537780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:27.539353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:27.544452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 432/884] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:27.555173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:27.571859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:27.761357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f8d65-ca5e-4e69-80de-259fe9b1fba7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:27.837138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:27.838169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:27.838642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:27.839116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:27.840343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:27.840910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:27.843498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cd411-09c1-4ed1-9f2e-b236f68a0358 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:27.853479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 453/885] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:27.862521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:28.031700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:28.067793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cda4a-025d-481e-8eb6-a9ebc1716ec1 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:28.092949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f370-02b2-425c-9ea4-828380be9294 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:28.093480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f370-02b2-425c-9ea4-828380be9294 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:28.093970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f370-02b2-425c-9ea4-828380be9294 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:28.095946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 454/886] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:28.104571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:28.105084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:28.105550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:28.138163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:28.139575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:28.140181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:28.140764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:28.141321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:28.141924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:28.143152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:28.143864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:28.146639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:28.160698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 433/887] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:28.167081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:28.296051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 455/888] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:28.399933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3279d-5bd4-4ee8-8c62-82709f0c9856 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:28.472932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428ebfd-b122-4967-9915-962278e580be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:28.474328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428ebfd-b122-4967-9915-962278e580be None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:28.475015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428ebfd-b122-4967-9915-962278e580be None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:28.475734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428ebfd-b122-4967-9915-962278e580be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:28.477391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428ebfd-b122-4967-9915-962278e580be None admin] RBAC: Adding query filter params (interface=public, service_id=8169d38caa0b4d5db184ff49499ab3c6, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:28.478118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428ebfd-b122-4967-9915-962278e580be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:28.481840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428ebfd-b122-4967-9915-962278e580be None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:28.498433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 434/889] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:28 2022] GET /identity/v3/endpoints?service_id=8169d38caa0b4d5db184ff49499ab3c6&interface=public®ion_id=RegionOne => generated 194 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:28.507609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:28.512346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:28.726001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d62366-eda7-45f7-88cb-bad959165cdd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:28.800818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:28.802878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:28.803345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:28.803829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:28.805678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:28.806871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428ebfd-b122-4967-9915-962278e580be None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:28.810060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:28.832888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 456/890] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:28 2022] GET /identity/v3/services => generated 1268 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:08:28.835356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:29.034420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428ebfd-b122-4967-9915-962278e580be None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:29.112686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:29.112686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.113133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.113545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.114639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:29.117493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:29.136432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:29.138286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:29.141085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 435/891] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Sep 1 05:08:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:29.150937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:29.291439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:29.364892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed576c-020b-47f1-bb20-716413e923f3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:29.437257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:29.438840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.439629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.440444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.441994 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:29.442823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:29.445840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f32c9-e926-457d-86c0-b4fc64b9a303 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:29.456567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 457/892] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:29.466582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:29.547280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedf67-f81a-4d41-877e-3f6779cfc880 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.548176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedf67-f81a-4d41-877e-3f6779cfc880 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.548761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bedf67-f81a-4d41-877e-3f6779cfc880 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.558257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 458/893] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:29.560912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f84f-21c0-466e-8d7d-51e5db3d4788 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.561591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f84f-21c0-466e-8d7d-51e5db3d4788 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.562183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05f84f-21c0-466e-8d7d-51e5db3d4788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.599915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ed05f84f-21c0-466e-8d7d-51e5db3d4788 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:29.602469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ed05f84f-21c0-466e-8d7d-51e5db3d4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:29.628374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:29.665036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a2d-3eac-4482-bed2-76f5270e053c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:29.715484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:29.716284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.716749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.717152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.717969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:29.718393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:29.720825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95616254-61d6-4f42-9f56-7a0561176291 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:29.726105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 436/894] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:29.727401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432cac-1361-4370-a401-f404d172be49 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.727946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432cac-1361-4370-a401-f404d172be49 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.728216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432cac-1361-4370-a401-f404d172be49 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.729692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 437/895] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:29.735295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432cac-1361-4370-a401-f404d172be49 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:29.761946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 459/896] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:29.765202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.765940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.766606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.801513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:29.804057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:29.892789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432cac-1361-4370-a401-f404d172be49 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:29.898570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:29.913621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 460/897] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:29.967751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:29.969360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:29.970049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:29.970665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:29.971928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] RBAC: Adding query filter params (interface=public, service_id=44050f9705534821bc793e4a45cf9197, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:29.972552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:29.975080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:29.986092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 438/898] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:29 2022] GET /identity/v3/endpoints?service_id=44050f9705534821bc793e4a45cf9197&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:29.995063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:30.181743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:30.192566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:30.211719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d9a30-6afe-450c-9aeb-b2081f5d32ff None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:30.278951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:30.279985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:30.280463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:30.281012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:30.282081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:30.284603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:30.297284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 461/899] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:29 2022] GET /identity/v3/services => generated 1268 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:08:30.298769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:30.354785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a49a2-13df-4d16-87f8-1ab1ef8adb00 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:30.428976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:30.430073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:30.430535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:30.431012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:30.432703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:30.435317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:30.442589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:30.470811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 439/900] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:30 2022] POST /identity/v3/services => generated 241 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:08:30.562998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21ebf-b46c-41d5-b948-a00d6434256c None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:30.642674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:30.643721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:30.644122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:30.644522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:30.665258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:30.674156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:30.675931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:30.677570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 462/901] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 1 05:08:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:30.685163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:30.813038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:30.897441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb9014-9d2b-4745-bc3b-879b042e6d52 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:30.973181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:30.974583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:30.975365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:30.976102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:30.977623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:30.978486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:30.982582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:31.000181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 440/902] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:08:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:31.009554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:31.147677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1255-698a-46c4-9b4d-29357ba4a63b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:31.161148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:31.190454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:31.191127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:31.191403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:31.191670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:31.204342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:31.205891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:31.223764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:31.225769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:31.227486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:31.227486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:31.227486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:31.227486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 463/903] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:31.231818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:31.412361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7194-7bb2-450c-acf8-821df1a4cb62 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:31.457133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:31.481817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:31.482799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:31.483147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:31.483620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:31.486061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:31.486061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:31.488338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:31.514203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 441/904] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:31.519478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:31.641312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816c14-5621-4656-9753-e05aee3ecc66 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:31.704096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:31.705197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:31.705677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:31.706149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:31.721911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:31.724590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6854eaee-de77-4cef-a999-270a601e1906 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:31.749319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:31.752408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:31.754560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 464/905] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:08:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:31.760656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:31.813052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc46a2-4ac5-4165-96fb-b19943ed518e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:31.813349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc46a2-4ac5-4165-96fb-b19943ed518e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:31.813672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc46a2-4ac5-4165-96fb-b19943ed518e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:31.815484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 465/906] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:31.820988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:31.821394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:31.821570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:31.845916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:31.847152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:31.916394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:31.930440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8ccf3-7dd0-4559-8863-962dcd1f8d6d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:31.976044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:31.976400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 466/907] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:31.981733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:31.982582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:31.983265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:31.984952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:31.985757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:31.989004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:32.024573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 442/908] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 1 05:08:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:32.038559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:32.176296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c5ee-c3dd-453b-9313-6a74a109eb82 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:32.216297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:32.216963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.217239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.217506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.243000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:32.297460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:32.299009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:32.417792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 467/909] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:32.424109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:32.435284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:32.478475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:32.497289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:32.560100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e22eb-7049-480a-aea1-20c7d1977f23 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:32.561411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc86cb5-a29c-46ac-b97a-92cc2df04cce None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:32.611999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:32.612816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.613163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.613503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.627754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:32.629565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:32.632862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:32.634583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.635075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.635565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.636735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:32.640260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:32.648823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:32.649913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:32.651129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:32.651129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:32.651129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:32.651129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 443/910] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:32.657505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:32.659557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:32.661357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:08:32.662662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:32.668681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 468/911] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:32.674706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:32.809209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4576a60-da59-4a06-9a3e-683b1553d0f3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:32.822012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:32.831372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22079c4-31c5-4003-8502-2ec3bc50fb46 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:32.834786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:32.869179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:32.870309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.870801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.871275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.872423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:32.872975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:32.873602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:32.874238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.874514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.874783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.875442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:32.875686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb58fb6-4ada-4470-8e70-488c9d241a6e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:32.875785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:32.877312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9150-b10a-49cd-906d-d8ec8db866d4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:32.888702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 469/912] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:32.888702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b2c99-ab19-4e48-a575-cf2bcb2da1e2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.888702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b2c99-ab19-4e48-a575-cf2bcb2da1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.888702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b2c99-ab19-4e48-a575-cf2bcb2da1e2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.891043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 470/913] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:32.895477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b2c99-ab19-4e48-a575-cf2bcb2da1e2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:32.898788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 444/914] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:32.904872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:32.904872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:32.904872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:32.922623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:32.923516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:33.019929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 445/915] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:33.021362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:33.073265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b2c99-ab19-4e48-a575-cf2bcb2da1e2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.115555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.116190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.116464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.116767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.117814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:33.117814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.119257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:33.131140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:33.131513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 471/916] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Sep 1 05:08:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:33.133808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:33.150162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a384b-1b56-474d-bbf4-ebf6e803c159 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.201760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:33.218574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.220458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.220990 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.221840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.232336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.234270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:33.248961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:33.249964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:33.250883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:33.258738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 446/917] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:33.260507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:33.322606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0490d1-a262-4b2a-9e7c-1e4f401faeaf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.393826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.394761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.395244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.395801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.397056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.399657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:33.405610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c566b7-27bd-4cd1-ab7d-917ca813fff5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.436216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 472/918] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:33.437827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:33.464106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.465444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.466000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.466482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.467551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:33.468086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.470058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:33.484128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:33.494344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 447/919] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:33.495791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:33.639956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:33.643555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd4fa1-f62d-4df1-a2fa-5e65f784cd46 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.695502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb03d7-9be6-4ca4-a61b-573720798b81 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.699012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.700101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.700550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.701046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.701758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.703329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:33.716744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:33.718587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:33.720191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 473/920] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Sep 1 05:08:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:33.726407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:33.774021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.775769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.777821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.778762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.780797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] RBAC: Adding query filter params (role.id=53cf9f7727ed4e5eb9732b1d5e2653fb, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=284d5528b1b84bd19e773ff09ee196ae) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:33.781636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.785752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024c09-aee2-4e38-99b7-ed49810c8431 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:33.798850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 448/921] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:33 2022] GET /identity/v3/role_assignments?user.id=284d5528b1b84bd19e773ff09ee196ae&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=53cf9f7727ed4e5eb9732b1d5e2653fb => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:33.829400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864a5e-3332-4a3f-b6b8-5d30523d46ca None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.829878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864a5e-3332-4a3f-b6b8-5d30523d46ca None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.830285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864a5e-3332-4a3f-b6b8-5d30523d46ca None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.832643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 449/922] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:33.841381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.841824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.842272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.873690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:33.876470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:33.939437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76e96b-f91f-49db-bc75-937755f7b5e3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:33.988350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:33.989051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:33.989325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:33.989584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:33.990237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:33.990536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:33.990747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:33.992239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:34.000754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 474/923] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:34.006010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:34.016677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 450/924] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:34.050185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:34.199843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874e79-e01b-4c5e-803a-532171262947 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:34.276541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:34.278089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:34.278848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:34.279600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:34.281169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:34.281991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:34.284900 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:34.295943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 475/925] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:34.301576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:34.417378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835a0b-d0fc-4543-b912-dc09d8f7e2d6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:34.457009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:34.457650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:34.457919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:34.458195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:34.458892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:34.460302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:34.486441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 451/926] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:34.517878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:34.706372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:34.718198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898651bd-5dc9-4a5e-8318-1b7c5bbbcaff None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:34.799142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:34.800560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:34.801287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:34.801986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:34.803367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:34.806402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:34.826008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:34.828296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:34.830261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:34.834854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 476/927] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:34.845234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:34.948504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:35.043565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14b121-9ce4-4170-bf15-81f328ae2139 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:35.118435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:35.120180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:35.121027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:35.121821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:35.123312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:35.124188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:35.127193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:35.138696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 452/928] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:35.147306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:35.351528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f13ff-5459-44e4-9f88-8a101fa9b690 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:35.420315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:35.421031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:35.421284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:35.421558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:35.422170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:35.422465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:35.423871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:35.430352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 477/929] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:35.440585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:35.641544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de8e8a-f44b-4190-a3fe-ffce84fbb26f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:35.670894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:35.720409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:35.721475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:35.721959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:35.722484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:35.723762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] RBAC: Adding query filter params (interface=public, service_id=e4978d8821d342c8a34e6e5f4c984cc7, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:35.724306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:35.726972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411ce2-32a7-449f-8262-2bf67ee18958 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:35.738078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 453/930] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:35 2022] GET /identity/v3/endpoints?service_id=e4978d8821d342c8a34e6e5f4c984cc7&interface=public®ion_id=RegionOne => generated 194 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:35.746877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:35.785117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:35.933804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc0e2a-58c3-4342-9926-86e078e447c4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:35.962135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668bdd-eb64-47f8-9a23-2514dc157a9a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:35.963616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668bdd-eb64-47f8-9a23-2514dc157a9a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:35.964594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668bdd-eb64-47f8-9a23-2514dc157a9a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:35.973840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 454/931] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:35.974978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24eb2-c88e-49c5-b9cc-ae1f30bf00f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:35.975614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24eb2-c88e-49c5-b9cc-ae1f30bf00f8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:35.975752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee431-8123-4f0a-9851-2e2abb14035d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:35.975896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24eb2-c88e-49c5-b9cc-ae1f30bf00f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:35.976004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee431-8123-4f0a-9851-2e2abb14035d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:35.976239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24eb2-c88e-49c5-b9cc-ae1f30bf00f8 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:35.976363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee431-8123-4f0a-9851-2e2abb14035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:35.978852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee24eb2-c88e-49c5-b9cc-ae1f30bf00f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:35.978852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee24eb2-c88e-49c5-b9cc-ae1f30bf00f8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:35.992682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 478/932] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:35 2022] GET /identity/v3/services => generated 1497 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:08:36.003287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5dfee431-8123-4f0a-9851-2e2abb14035d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:36.005236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5dfee431-8123-4f0a-9851-2e2abb14035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:36.146131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 455/933] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:36.387174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724d74-ee88-41fa-8137-c819ac219a4b None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:36.387984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724d74-ee88-41fa-8137-c819ac219a4b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:36.387984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724d74-ee88-41fa-8137-c819ac219a4b None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:36.389410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 479/934] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:36.395533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:36.395839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:36.396185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:36.416262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:36.417629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:36.498005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 456/935] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:36.646525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de724d74-ee88-41fa-8137-c819ac219a4b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:36.787454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:36.811591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de724d74-ee88-41fa-8137-c819ac219a4b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:36.845546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:36.859713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:36.860776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:36.861259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:36.861736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:36.863209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:36.866188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:36.871604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING keystone.server.flask.common [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 05:08:36.893770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:36.910480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.sql.core [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 05:08:36.910480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 05:08:36.910480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [parameters: {'id': '9a4e6be6b67148ada8e43378a1cdbb0e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 05:08:36.910480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a4e6be6b67148ada8e43378a1cdbb0e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a4e6be6b67148ada8e43378a1cdbb0e. Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:08:36.943149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 05:08:36.944080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application yield resource Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise self.value Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application session.commit() Sep 01 05:08:36.945785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.flush() Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application compat.raise_( Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 05:08:36.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 05:08:36.947715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:08:36.948814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [parameters: {'id': '9a4e6be6b67148ada8e43378a1cdbb0e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:36.949767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:36.951765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a4e6be6b67148ada8e43378a1cdbb0e. Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:36.954162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 480/936] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Sep 1 05:08:36 2022] POST /identity/v3/projects => generated 262 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:36.957225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:36.987696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f03b4-62b7-4021-8b94-2cda41c1ca90 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:37.030720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:37.031905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.032440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.032944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.051825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:37.057964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:37.059081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:37.059982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:37.062928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 457/937] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 1 05:08:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:37.072957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:37.153180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd7a6-18f5-4a9c-80f0-b25e0cd19c2b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:37.201729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:37.202735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.203195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.203642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.208078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:37.213172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:37.215318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:37.230228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:37.231210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:37.232195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:37.240081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 481/938] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:37.241954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:37.270885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:37.281681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ce44-fef7-4b73-a778-2ea26cab91dd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:37.353639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:37.354468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.355075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.355556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.356843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:37.357709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:37.360458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:37.366110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d82e3-bebd-4923-b64c-360a02015010 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:37.385046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 458/939] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:08:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:37.387918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:37.407333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:37.408704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.409218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.409666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.410615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:37.411174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:37.413094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68c85-ad7f-4bb6-ba5e-1624cbc7dc79 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:37.444669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 482/940] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:37.605690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c297-8f32-43d4-be61-1c88f42b4944 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:37.671577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a87c8-bc5d-43d4-95d4-bc8c433ac6b2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.672005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a87c8-bc5d-43d4-95d4-bc8c433ac6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.672448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a87c8-bc5d-43d4-95d4-bc8c433ac6b2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.674028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 483/941] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:37.679808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:37.680718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.680954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.681214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.684044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.684819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.685512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.707406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:37.710017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:37.719868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:37.721240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:37.741710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:37.742789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:37.743715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:37.743715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:37.743715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:37.744684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 459/942] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:37.750732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:37.780377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:37.849193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:37.889005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8c927-8668-4e61-97df-2bc893f16a7a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:37.890222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 484/943] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:37.963594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:37.965216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:37.967499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:37.968023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:37.969386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:37.969968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:37.972532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:37.998748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 460/944] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:38.009481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:38.188011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:38.240646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78471341-72d1-4d0c-8c4a-0ae69c398270 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:38.310310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:38.312506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:38.316662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:38.316662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:38.330631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:38.336549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:38.344371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:38.362555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:38.364690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:38.367059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 485/945] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:08:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:38.375915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:38.423196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5677f-e304-40ba-a6b6-5694580ac299 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:38.458868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:38.482461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:38.483160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:38.483449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:38.483691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:38.484342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:38.485785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-66d92455-1274-4f3b-9b75-1e10b91494b8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:38.498380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:38.500367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:38.501953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:38.503400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 461/946] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:38.506016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fea6-229f-4d0b-9df9-b5717e5b2760 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:38.506016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fea6-229f-4d0b-9df9-b5717e5b2760 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:38.506016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fea6-229f-4d0b-9df9-b5717e5b2760 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:38.508424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 462/947] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:38.514799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1fea6-229f-4d0b-9df9-b5717e5b2760 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:38.552345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d403f7-0d94-433e-9ac9-6773df8cc5f9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:38.619988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:38.621045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:38.621464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:38.621740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:38.622515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:38.622821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:38.624409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f31d-6eab-45b4-9fbf-f82782106f84 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:38.648507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 486/948] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 1 05:08:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:38.649923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:38.650252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:38.650510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:38.663786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1fea6-229f-4d0b-9df9-b5717e5b2760 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:38.671745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:38.673457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:38.719562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:38.720813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:38.721350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:38.721889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:38.722937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:38.724366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:38.726106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:38.730529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:38.737275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 463/949] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:38.739155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:38.774566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 487/950] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:38.775820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:38.856739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:38.939479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acb8bc-326a-4f94-8dbd-765a3a3ab329 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.006073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.008614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.009385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.010044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.028518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2fc58-3869-4758-afa1-8f759b2f8f27 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.039221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.043428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:39.073292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:39.074395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:39.075539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:39.075539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:39.075539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:39.082287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 464/951] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:39.083599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.100174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.101297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.101732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.102145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.103224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:39.103703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.106135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.116707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 488/952] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:39.116707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.163681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:39.270371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b42e5-5f4a-483b-93d8-e727799a6fd9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.335945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:39.343753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3357e-7c54-4315-896d-3978b2788f81 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.344028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.345004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.345489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.345959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.347029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.350681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:39.368390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:39.370563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:39.372448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:39.373979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 465/953] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:39.384582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.402303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.403692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.404177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.404671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.405765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:39.406248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.408937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.431476 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 489/954] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:39.440296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.589387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a7eef-4670-47c2-aaf8-581eb74fcf44 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.621068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750a10-ab08-4415-8222-c678d6f25d02 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.625818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:39.663412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.664095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.664383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.664720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.666981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.668795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.669709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.670528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.672075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:39.672991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.673481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.675031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.676855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.687300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 466/955] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:39.694108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:39.696029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:39.697864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 490/956] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:39.702258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.703240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.725820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:39.823905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2708887-9c31-4a95-be32-67707b5e5fea None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.865104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.865989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.866433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.866860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.867740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:39.868205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.869955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:39.891141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 491/957] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:39.892376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:39.914851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5e1b-4e67-4890-8101-e2f7482a7b00 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:39.989298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:39.990649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:39.991176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:39.991775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:39.993219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:39.993898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:39.997320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:40.012706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 467/958] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:40.015173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:40.028597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:40.067764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae621a2-300b-4aca-84b5-4aebb96481fd None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:40.107593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac80f4-1770-4e18-9ddf-6a1d59231767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:40.108320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac80f4-1770-4e18-9ddf-6a1d59231767 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:40.108614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac80f4-1770-4e18-9ddf-6a1d59231767 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:40.108890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac80f4-1770-4e18-9ddf-6a1d59231767 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/284d5528b1b84bd19e773ff09ee196ae/roles/53cf9f7727ed4e5eb9732b1d5e2653fb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:40.111229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac80f4-1770-4e18-9ddf-6a1d59231767 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=284d5528b1b84bd19e773ff09ee196ae, role_id=53cf9f7727ed4e5eb9732b1d5e2653fb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:40.112747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac80f4-1770-4e18-9ddf-6a1d59231767 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:40.118227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:40.140883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 492/959] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:08:39 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/284d5528b1b84bd19e773ff09ee196ae/roles/53cf9f7727ed4e5eb9732b1d5e2653fb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:08:40.246084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb3d9-4647-4995-8e7f-76196fb5e66e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:40.321086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889bc1-0c24-4407-9aee-9b2c07f80216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:40.322812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889bc1-0c24-4407-9aee-9b2c07f80216 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:40.323856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889bc1-0c24-4407-9aee-9b2c07f80216 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:40.324721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889bc1-0c24-4407-9aee-9b2c07f80216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:40.326428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889bc1-0c24-4407-9aee-9b2c07f80216 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:40.329691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889bc1-0c24-4407-9aee-9b2c07f80216 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:40.368905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 468/960] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:08:40.477143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123941c-fcc8-44de-bd2f-cea442567212 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:40.477652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123941c-fcc8-44de-bd2f-cea442567212 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:40.478069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123941c-fcc8-44de-bd2f-cea442567212 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:40.482802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 493/961] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:40.488482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:40.488787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:40.489061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:40.510851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:40.512109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:40.670336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 469/962] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:41.171863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123941c-fcc8-44de-bd2f-cea442567212 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:41.351683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123941c-fcc8-44de-bd2f-cea442567212 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:41.421674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:41.423270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:41.423739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:41.424199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:41.425405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:41.428059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:41.448980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:41.457594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.sql.core [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 05:08:41.457594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 05:08:41.457594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [parameters: {'user_id': '4e09d6725f624e5487f1b84e6db9a03b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 05:08:41.457594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-150bd0ee-338f-449c-8d6b-1e89ca79f47a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 05:08:41.477443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:08:41.479268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application yield resource Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise self.value Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application session.commit() Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 05:08:41.481509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.session.flush() Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application compat.raise_( Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 05:08:41.485895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:08:41.487690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application result.read() Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:08:41.493681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [parameters: {'user_id': '4e09d6725f624e5487f1b84e6db9a03b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:41.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 05:08:41.509211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:41.514575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 494/963] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Sep 1 05:08:41 2022] POST /identity/v3/users => generated 160 bytes in 333 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:41.525867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:41.584791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:41.665579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a39c2d-7048-45fc-8b67-9a411aa8238d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:41.667068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a39c2d-7048-45fc-8b67-9a411aa8238d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:41.668926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a39c2d-7048-45fc-8b67-9a411aa8238d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:41.682743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 495/964] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:41 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:41.688515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:41.688958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:41.689135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:41.710542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:41.712266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:41.740286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6355407-9571-4ce4-a5ba-e2f50269bb2e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:41.803889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:41.805448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:41.805744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:41.806004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:41.820352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:41.821884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:41.836894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:41.838838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:08:41.840756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:41.844960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 470/965] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:41.844960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:41.854386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 496/966] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:42.016074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:42.052594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29898-497e-4ab3-92a5-0da52d284966 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:42.124161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:42.125251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:42.125732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:42.126206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:42.127561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:42.128088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:42.129407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:42.130876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d305-3caf-46e1-96da-bc341d36f6fe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:42.204659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 471/967] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Sep 1 05:08:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:42.323445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963bba6-0cb2-4fdc-8407-141e0ac21c7d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:42.384603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:42.395935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5f06-7ef8-4045-ae5e-bfd7cc4d67eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:42.397016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5f06-7ef8-4045-ae5e-bfd7cc4d67eb None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:42.397491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5f06-7ef8-4045-ae5e-bfd7cc4d67eb None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:42.397933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5f06-7ef8-4045-ae5e-bfd7cc4d67eb None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:42.399274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5f06-7ef8-4045-ae5e-bfd7cc4d67eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:42.402193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5f06-7ef8-4045-ae5e-bfd7cc4d67eb None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:42.434722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 497/968] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:42 2022] POST /identity/v3/services => generated 242 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:42.904153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2d7d-161a-4ed8-8e0d-76dea13e9633 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:42.904732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2d7d-161a-4ed8-8e0d-76dea13e9633 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:42.905168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2d7d-161a-4ed8-8e0d-76dea13e9633 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:42.907706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 472/969] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:42.913899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856908-614d-4bd5-925d-1a819fcdb93c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:42.914186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856908-614d-4bd5-925d-1a819fcdb93c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:42.914545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856908-614d-4bd5-925d-1a819fcdb93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:42.936431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9a856908-614d-4bd5-925d-1a819fcdb93c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:42.938056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9a856908-614d-4bd5-925d-1a819fcdb93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:43.029549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 498/970] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:43.122162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36a87a-e588-429f-8957-e9cc39d85759 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.122433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36a87a-e588-429f-8957-e9cc39d85759 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.122879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36a87a-e588-429f-8957-e9cc39d85759 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:43.124359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 473/971] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:43.130194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.130452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.130818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:43.152645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:43.153906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:43.240846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 499/972] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:43.306766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36a87a-e588-429f-8957-e9cc39d85759 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:43.437231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36a87a-e588-429f-8957-e9cc39d85759 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:43.483397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:43.484347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.484814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.485214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:43.505389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:43.516303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:43.517387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:43.518260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:43.521020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 474/973] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 1 05:08:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:43.528806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:43.537048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:43.544060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:43.600082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:43.689654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a93b-1cd0-4cfb-9b42-074c6f3853c3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:43.698572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d839-56db-4b45-9db6-09027a35bcb0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:43.741281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:43.742061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.742348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.742623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:43.743227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:43.744887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:43.748144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:43.749182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.749662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.750135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:43.751320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:43.751844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:43.754385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:43.756305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:43.757824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:43.759039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:43.763120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 475/974] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:43.769668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:43.774313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 500/975] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:08:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:43.781039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:43.874355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:43.925977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9dd5-7dc1-4d92-8ec9-7dde69ce2a62 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:43.936998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc4375-a73a-4b63-81e1-c1979c7ea9e1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:43.950591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:43.970609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:43.971240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.971913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.971913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:43.972441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:43.972753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:43.974172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:43.987620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 476/976] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:43.989053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:43.992145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:43.992834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:43.994343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:43.994343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.005833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.007773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:44.025207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:44.026384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:44.028524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:44.028524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:44.028524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:44.028524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 501/977] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:44.034418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:44.136868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18610e89-7f44-4e89-b9ad-70c0fb509dca None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:44.172733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:44.173874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768b18-d4ec-4d54-b558-8f5aca9c57b9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:44.181400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:44.182279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:44.182707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:44.183128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.183961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:44.184377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.186363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.200166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 477/978] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:44.201904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:44.235974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:44.236657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:44.236936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:44.237184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.237858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:44.238157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.239627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.253501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 502/979] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:44.264176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:44.292222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:44.360413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca202c-89ef-4101-a1c3-bfe04d541733 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:44.416155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee0db5-af4b-4b19-a10f-e1957e3a634f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:44.419036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:44.420017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:44.420441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:44.420803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.421609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] RBAC: Adding query filter params (interface=admin, service_id=e4978d8821d342c8a34e6e5f4c984cc7, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:44.421979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.424448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.433981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 478/980] 10.222.0.57 () {56 vars in 1249 bytes} [Thu Sep 1 05:08:44 2022] GET /identity/v3/endpoints?service_id=e4978d8821d342c8a34e6e5f4c984cc7&interface=admin®ion_id=RegionOne => generated 193 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:44.442762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:44.477132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:44.478504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:44.479256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:44.480020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.493599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.496935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:44.512674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:44.514726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:44.515975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 503/981] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:08:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:44.521488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:44.537452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:44.609394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4cc05-de27-4e99-809d-0fb21f799684 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:44.668066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:44.668827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:44.669672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:44.670096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:44.670558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.672086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.674445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.685734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 479/982] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:44 2022] GET /identity/v3/services => generated 1727 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:08:44.706626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8004ca5-4dc9-4985-9cac-3f198d1e8b1e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:44.774307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:44.775609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:44.776347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:44.777057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:44.778672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:44.779419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:44.782037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:44.817637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 504/983] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Sep 1 05:08:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:44.827130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:44.992517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd734b-6d7a-4258-9803-039061afb287 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:45.023942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:45.042948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:45.043608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:45.043881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:45.044150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:45.128780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:45.130290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:45.264566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 480/984] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:44 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:45.270784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:45.409514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78287d-31a3-43d4-8d1f-18c96c43f9cf None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:45.453351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:45.454016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:45.454286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:45.454549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:45.462907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:45.469700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:45.471666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-9d02bceb-6461-4ddd-bea1-8bcdef15e8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:45.489390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:45.491226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:45.493980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:45.493980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:45.493980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:45.499577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 505/985] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:45.499827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:45.499976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4d727-373c-40c7-8018-a21917ce444a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:45.499976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4d727-373c-40c7-8018-a21917ce444a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:45.499976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4d727-373c-40c7-8018-a21917ce444a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:45.500687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 506/986] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:45.507270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:45.507695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:45.508125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:45.530181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:45.531731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:45.533661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:45.624994 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 507/987] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:45.642028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4afcd-8548-4c29-b51a-d0f4df2b9da4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:45.711382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:45.712275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:45.712791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:45.713352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:45.714558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:45.715300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:45.717890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:45.748662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 481/988] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:45.752379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:45.907007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:45.945325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a46ac4-2bd3-4a17-b37e-212a9e17b1fa None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:45.974734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:46.000532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.001783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.002371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.002900 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.018127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.020934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:46.044916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:46.045993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:46.047065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 508/989] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:46.054749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:46.059478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:46.091235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db893a-ab36-4148-92d8-b887da9213f8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:46.153355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.154459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.154850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.155308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.156283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.158760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:46.174136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:46.176582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:46.178607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 482/990] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:46.184555 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:46.225932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981e5df-8bf0-41e4-bf87-8e75b81be897 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:46.278523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.279473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.279909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.280332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.281622 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:46.282059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.284320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.302626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 509/991] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:46.314200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:46.381291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86395e3a-7646-4ddf-86da-8d5e7089a0e6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:46.393265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:46.439444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.440417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.440844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.441215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.442571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:46.443045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.445417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.456679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 483/992] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:46.459670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:46.486445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:46.498180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cdefb-8b10-4622-b9ea-44cfe0f044ac None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:46.556397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.557567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.558020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.558470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.559755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] RBAC: Adding query filter params (role.id=53cf9f7727ed4e5eb9732b1d5e2653fb, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=284d5528b1b84bd19e773ff09ee196ae) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:46.560282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.562565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.580675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 510/993] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:46 2022] GET /identity/v3/role_assignments?user.id=284d5528b1b84bd19e773ff09ee196ae&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=53cf9f7727ed4e5eb9732b1d5e2653fb => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:46.640956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d1a3-dfd3-4b80-9f0d-2a55cfd37f87 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:46.687900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.688894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.689404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.689831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.690692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:46.691167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.692900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.705262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 484/994] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:46.707267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:46.887161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4884a-7892-4f3d-a64e-aa4df2943439 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:46.891806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:46.962197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:46.963429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:46.963989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:46.964654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:46.966106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] RBAC: Adding query filter params (interface=public, service_id=283e6e5b70fd44b883f600eb908fc669, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:46.966781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:46.969508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31162182-81fb-40dc-a72e-2e9ee32e1a5b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:46.985550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 511/995] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:46 2022] GET /identity/v3/endpoints?service_id=283e6e5b70fd44b883f600eb908fc669&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:46.986917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:47.089565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:47.121196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040b21-7362-442b-9468-33fa2a091d87 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:47.163623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3f68d-fde3-425c-9ea8-27261a4cefbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:47.164231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3f68d-fde3-425c-9ea8-27261a4cefbd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:47.164513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3f68d-fde3-425c-9ea8-27261a4cefbd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:47.164842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3f68d-fde3-425c-9ea8-27261a4cefbd None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:47.165485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3f68d-fde3-425c-9ea8-27261a4cefbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:47.167173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3f68d-fde3-425c-9ea8-27261a4cefbd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:47.174896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 485/996] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:46 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:08:47.245056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7086-f2cd-48c1-a389-898e561d5b79 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:47.245497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7086-f2cd-48c1-a389-898e561d5b79 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:47.245626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7086-f2cd-48c1-a389-898e561d5b79 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:47.247322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 512/997] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:47.253263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:47.253545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:47.253863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:47.275600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:47.276924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:47.367903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 486/998] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:47.641690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf7086-f2cd-48c1-a389-898e561d5b79 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:47.813242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf7086-f2cd-48c1-a389-898e561d5b79 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:47.876122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:47.877194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:47.877666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:47.878127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:47.879181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:47.882508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:47.899573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:47.902227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:08:47.903123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:47.905008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 513/999] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Sep 1 05:08:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:47.911291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:48.004874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:48.068719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f4ce5-cf23-46ae-92c2-92c6c0275680 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:48.132827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:48.133848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:48.134314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:48.134748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:48.135953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:48.136470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:48.138989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:48.148132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 487/1000] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:48.154896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:48.214785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:48.302134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272374-5d1b-4d31-b6bf-23f91798cd9b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:48.348187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:48.348927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:48.349200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:48.349457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:48.350111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:48.350409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:48.351823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b46ca-38c7-4e60-8f0b-0bbaa54078c1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:48.358436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 514/1001] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Sep 1 05:08:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:48.365058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:48.542836 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7b90-2b7d-49af-b210-775b4c14ce54 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:48.589078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33b8f-a793-4add-a302-db1a307aeb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:48.589883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33b8f-a793-4add-a302-db1a307aeb05 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:48.590163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33b8f-a793-4add-a302-db1a307aeb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:48.590444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33b8f-a793-4add-a302-db1a307aeb05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:48.591180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33b8f-a793-4add-a302-db1a307aeb05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:48.592961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33b8f-a793-4add-a302-db1a307aeb05 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:48.599758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:48.620679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 488/1002] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:08:48.841056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443d4a-016d-429f-bcfb-3c4991f7ef0b None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:48.841517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443d4a-016d-429f-bcfb-3c4991f7ef0b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:48.841965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443d4a-016d-429f-bcfb-3c4991f7ef0b None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:48.843847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 515/1003] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:48.850317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664247-79af-42f2-a878-46099d03b20c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:48.850675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664247-79af-42f2-a878-46099d03b20c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:48.850840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664247-79af-42f2-a878-46099d03b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:48.879041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-40664247-79af-42f2-a878-46099d03b20c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:48.881025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-40664247-79af-42f2-a878-46099d03b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:49.033940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 489/1004] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:49.538666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe652b6-6032-4dcc-a5be-33de4accc7c1 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:49.539507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe652b6-6032-4dcc-a5be-33de4accc7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:49.539507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe652b6-6032-4dcc-a5be-33de4accc7c1 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:49.540499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40664247-79af-42f2-a878-46099d03b20c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:49.541290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 516/1005] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:49.550728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:49.551212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:49.551662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:49.584481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:49.586610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:49.702570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40664247-79af-42f2-a878-46099d03b20c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:49.714281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 517/1006] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:49.744110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:49.778887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:49.779977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:49.780442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:49.780978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] PATH_INFO: `/v3/services/image` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:49.782103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:49.785092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:49.802844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:49.804108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:08:49.805106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:49.805945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 490/1007] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Sep 1 05:08:49 2022] GET /identity/v3/services/image => generated 86 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:49.811183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:49.846010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:49.948259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e412aa-b434-4962-b8d6-4192061770a2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:49.991312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:49.991947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:49.992226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:49.992491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:49.993197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] RBAC: Adding query filter params (name=image) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:49.993496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:49.994955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:50.001301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 518/1008] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:50.008371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:50.148808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:50.197811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30f9e9-53b0-4b74-bcd6-67f196fcae90 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:50.265017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:50.265714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:50.266016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:50.266324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:50.267015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] RBAC: Adding query filter params (type=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:50.267350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:50.269161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:50.275132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 491/1009] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:50.320212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:50.342154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d2c9-8dcd-4afb-9f7e-4480e7ff042d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:50.422902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:50.423962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:50.424453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:50.425297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:50.426645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:50.429392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:50.449703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:50.451795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:08:50.453574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:50.457513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 519/1010] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:50.463915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:50.557511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:50.663110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d34b0-3856-4ed6-b914-a619c0ade7bd None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:50.733588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:50.734973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:50.735661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:50.736325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:50.737687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:50.738444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:50.741191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c5096-6ad2-4e5a-8c93-e419509998ef None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:50.751890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 492/1011] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:50.759564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:50.931156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae03c1-f879-4f87-aa67-9d87208c891a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:50.932008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae03c1-f879-4f87-aa67-9d87208c891a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:50.932480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae03c1-f879-4f87-aa67-9d87208c891a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:50.935014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 493/1012] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:50.941098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:50.941398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:50.941701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:50.963831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427ffdc-29aa-4761-82ba-e6c01af5dc26 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:50.966076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:50.968136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:51.013375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:51.013904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:51.014190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:51.015012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:51.015677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] RBAC: Adding query filter params (type=compute) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:51.015982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:51.017741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:51.033591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 520/1013] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Sep 1 05:08:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:51.035269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:51.061871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:51.093796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 494/1014] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:51.239547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b834-eea6-4068-ac83-d012c4316bca None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:51.309464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:51.310863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:51.311590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:51.312274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:51.313786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:51.316790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:51.354722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 521/1015] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:08:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:51.386314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:51.446087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:51.529132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8917d0c-8897-4638-83d3-2dcc8d62e311 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:51.585672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7efe2d-9bfb-4b12-b642-b1cbff50f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:51.586660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7efe2d-9bfb-4b12-b642-b1cbff50f474 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:51.586660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7efe2d-9bfb-4b12-b642-b1cbff50f474 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:51.586888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7efe2d-9bfb-4b12-b642-b1cbff50f474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:51.588355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7efe2d-9bfb-4b12-b642-b1cbff50f474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:51.590070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7efe2d-9bfb-4b12-b642-b1cbff50f474 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:51.592358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 495/1016] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:51.598685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:51.751127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:51.815375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7d975-f185-483e-88e3-18a87679b769 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:51.891010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a7a7b-c2ac-45eb-b55f-34dc4d25f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:51.891551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a7a7b-c2ac-45eb-b55f-34dc4d25f46f None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:51.891828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a7a7b-c2ac-45eb-b55f-34dc4d25f46f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:51.892089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a7a7b-c2ac-45eb-b55f-34dc4d25f46f None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:51.892825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a7a7b-c2ac-45eb-b55f-34dc4d25f46f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:51.894362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a7a7b-c2ac-45eb-b55f-34dc4d25f46f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:51.930429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 522/1017] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:51 2022] POST /identity/v3/projects => generated 311 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:08:52.638739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897660d3-4b75-46b1-ab98-7adf544b75db None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:52.639309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897660d3-4b75-46b1-ab98-7adf544b75db None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:52.639677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897660d3-4b75-46b1-ab98-7adf544b75db None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:52.642437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 496/1018] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:52.648422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27916c6e-c4f0-40cf-9d33-8be6679d7308 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:52.648873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27916c6e-c4f0-40cf-9d33-8be6679d7308 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:52.649037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27916c6e-c4f0-40cf-9d33-8be6679d7308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:52.669036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-27916c6e-c4f0-40cf-9d33-8be6679d7308 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:52.670283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-27916c6e-c4f0-40cf-9d33-8be6679d7308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:52.756074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 523/1019] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:52 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:53.074264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897660d3-4b75-46b1-ab98-7adf544b75db None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:53.276116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897660d3-4b75-46b1-ab98-7adf544b75db None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:53.292969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:53.349127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e366ef-a298-4c04-ba47-a7c3ea6e2095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:53.350215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e366ef-a298-4c04-ba47-a7c3ea6e2095 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:53.350678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e366ef-a298-4c04-ba47-a7c3ea6e2095 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:53.351143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e366ef-a298-4c04-ba47-a7c3ea6e2095 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:53.352296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e366ef-a298-4c04-ba47-a7c3ea6e2095 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:53.354900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e366ef-a298-4c04-ba47-a7c3ea6e2095 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:53.382849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 497/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:08:53 2022] POST /identity/v3/services => generated 242 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:54.419401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242e2c-25b7-483c-8d09-d0017fb720b0 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:54.420227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242e2c-25b7-483c-8d09-d0017fb720b0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:54.420227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242e2c-25b7-483c-8d09-d0017fb720b0 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:54.421389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 524/1021] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:54.428733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:54.429298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:54.429647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:54.437785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59453d6-ff2a-49f1-85ff-6d0b6541f60d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:54.438255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59453d6-ff2a-49f1-85ff-6d0b6541f60d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:54.438714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59453d6-ff2a-49f1-85ff-6d0b6541f60d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:54.441185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 525/1022] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:54.448107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:54.448587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:54.449069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:54.461130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:54.463182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:54.482154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:54.484297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:54.586391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:54.600527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 498/1023] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:08:54.624694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 526/1024] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:55.063717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:55.099140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:55.213967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:55.227693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2131877-8d63-4380-b80a-fe8216ca50b5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:55.262529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a0b85-5bce-480d-84b5-736cfdccc6ea None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:55.286143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:55.287218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:55.287705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:55.288079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:55.289894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:55.292684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:55.295364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 499/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:55.305138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:55.324171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:55.325201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:55.325645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:55.326075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:55.344270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:55.353124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:55.354482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:55.355391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 527/1026] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 1 05:08:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:55.364135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:55.422608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:55.475368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bf17-2a1a-4f3f-8ede-7468498669b6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:55.495683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c65f7-8a2c-4381-8bc1-58b8e688abf6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:55.519130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:55.519761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:55.520047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:55.520316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:55.521031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:55.522567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:55.557338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:55.558465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:55.558908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:55.559331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:55.560456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:55.560975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:55.561690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 500/1027] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:08:55 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:08:55.566582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:55.578450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 528/1028] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:08:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:55.585488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:55.610095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:55.731846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1579-b8b4-4c6f-9b8e-17f3f08ed9bb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:55.783848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:55.784530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:55.784828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:55.785140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:55.799390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:55.800947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:55.823388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:55.825286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:55.827972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:55.827972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:55.827972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:55.827972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 501/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:55.831962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:55.997822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dae09-8992-42fc-ae41-0d9ee28a7bd3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:56.009564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:56.064524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:56.065659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.066135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.066657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.067790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:56.068307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:56.070985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295aaa6-9c14-4d01-8c76-61f5adafd835 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:56.093148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 529/1030] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:56.099702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:56.229364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:56.270890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502ed7-728d-4e9a-9666-686774870a32 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.271266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502ed7-728d-4e9a-9666-686774870a32 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.271446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502ed7-728d-4e9a-9666-686774870a32 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.276716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 530/1031] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:08:56.279284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.279284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.279569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.299964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:56.301273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:56.306775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54b477-caaa-45ee-a87c-d26092b84888 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:56.368941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:56.369547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.369824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.370093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.380892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:56.383523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:08:56.403364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:56.404484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:56.405930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 502/1032] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:08:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:56.413656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:56.420343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 531/1033] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:56.552484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661310a-eae5-43e7-a7ef-8fdab31f11e8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:56.585917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:56.597511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:56.598316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.598716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.599109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.600053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:56.600506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:56.602241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:56.630132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 503/1034] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:08:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:56.632158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:56.693910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:56.780586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:56.787301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4f92-f221-4ec2-a6b2-e32f83cb0eba None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:56.833669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:56.834415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.834699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.834954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.888319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5432-1b86-4348-b00f-c8518229d43b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:56.939761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:56.941379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:56.949265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:56.950166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:56.950629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:56.951616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] PATH_INFO: `/v3/services/image` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:56.952010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:56.953626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:56.966920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:56.969290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:08:56.971522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:08:56.976416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 504/1035] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Sep 1 05:08:56 2022] GET /identity/v3/services/image => generated 86 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:56.977612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.052886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:57.101952 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:57.110736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 532/1036] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:57.117213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.125571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02fb6-6849-44de-b794-4ea79609391b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.179325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.180227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.180717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.181295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.182408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] RBAC: Adding query filter params (name=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:57.182937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.185823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.192087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 505/1037] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:57.201589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.259982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fa5d-6848-4d62-83a4-8a9bc6220da6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.300056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.300755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.301059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.301288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.314349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.315861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:08:57.333420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:57.334510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:08:57.335634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:08:57.335634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:08:57.335634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:57.335634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 533/1038] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:57.344910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.375263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641432-6f89-40a5-8a38-29299e840134 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.393631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:57.418070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.418705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.418982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.419263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.419906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] RBAC: Adding query filter params (type=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:57.420247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.422421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.430079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 506/1039] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:57.436122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:57.436330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.507521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5550-574c-4f57-89d1-d8e3d44c3806 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.552056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.552729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.553099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.553263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.553936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:57.554250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.555675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.562264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b86f3f-77fd-4287-899d-d10cfd533b0e None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.571339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 534/1040] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:08:57.577368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.609349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.610015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.610491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.610779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.611511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] RBAC: Adding query filter params (interface=public, service_id=134a0df71df445568aa0146adea316dd, region_id=RegionOne) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:57.611821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.613674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.626288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 507/1041] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/endpoints?service_id=134a0df71df445568aa0146adea316dd&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:57.627293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.686004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:57.713874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8721495-f3ac-4d73-8514-dd38c49701ec None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.730444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:57.774980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.776059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.776559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.777052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.788853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9d8f-980e-48c4-b08d-900d33e8f1ae None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:57.790332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.793232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3e9076eb-98de-4577-b87c-a1f8cc5e4e45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:08:57.813514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:57.814604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:57.815771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 535/1042] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:08:57.817837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87353cfe-c31b-4b4d-9253-675fc5af7bf9 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.818354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87353cfe-c31b-4b4d-9253-675fc5af7bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.818821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87353cfe-c31b-4b4d-9253-675fc5af7bf9 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.821932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 536/1043] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:08:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:57.825240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87353cfe-c31b-4b4d-9253-675fc5af7bf9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:57.848468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7e1b-ed70-4eb4-b933-0c8a6f47f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:57.849429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7e1b-ed70-4eb4-b933-0c8a6f47f262 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.849792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7e1b-ed70-4eb4-b933-0c8a6f47f262 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.850136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7e1b-ed70-4eb4-b933-0c8a6f47f262 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.850823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7e1b-ed70-4eb4-b933-0c8a6f47f262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:57.852332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7e1b-ed70-4eb4-b933-0c8a6f47f262 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:57.860447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 508/1044] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/services => generated 1957 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:08:57.863063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:57.863550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:57.864053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:57.893873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:57.895834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:57.993556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87353cfe-c31b-4b4d-9253-675fc5af7bf9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:58.012663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 509/1045] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:08:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:08:58.070522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:58.071604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:58.072114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:58.072575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:58.073942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:58.074461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:58.077217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:58.100068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 537/1046] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:58.106913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:58.154082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:58.240886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0bbb1-ab69-4c8f-9179-512080abe07c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:58.285532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:58.286065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:58.286418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:58.286695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:58.287472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] RBAC: Adding query filter params (role.id=53cf9f7727ed4e5eb9732b1d5e2653fb, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a467a7344fff4987967c8655dc2965a1) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:58.287776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:58.289354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:58.296949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 510/1047] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:58 2022] GET /identity/v3/role_assignments?user.id=a467a7344fff4987967c8655dc2965a1&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=53cf9f7727ed4e5eb9732b1d5e2653fb => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:58.343336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:58.385155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:58.485775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb22b4-bce0-417f-9f2d-d1b780d8104b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:58.529545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:58.530369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:58.530795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:58.531187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:58.545959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:08:58.551084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:08:58.553314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:08:58.554914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:08:58.556739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 538/1048] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:08:58.561886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:58.745602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:58.752868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d533855-6444-426a-9597-8f66381ebc54 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:58.810099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:58.810622 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:58.810897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:58.811173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:58.811859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:58.812160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:58.813618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:58.825729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 511/1049] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:58.831718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:58.965347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:58.979260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711c5f0-0042-434f-948e-993295f274d2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:59.023331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:59.024163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:59.024567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:59.025005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] PATH_INFO: `/v3/users/a3c1468a3ebf4fdbb8d2160f78d43bc9` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:59.046648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c1468a3ebf4fdbb8d2160f78d43bc9)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:59.048395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:59.050638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 539/1050] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:08:58 2022] GET /identity/v3/users/a3c1468a3ebf4fdbb8d2160f78d43bc9 => generated 285 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:59.057211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:59.190295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d4129-8b99-4500-b74e-a3352bff9130 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:59.227946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:59.228903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:59.229212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:59.229489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:59.265112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:59.310712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:59.312293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:59.444251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 512/1051] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:08:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:08:59.446097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:59.575020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bdc71-55a5-4d09-a2ac-d1cd9f275373 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:59.618640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939dc2c-5825-4253-a090-6561a3086ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:59.619584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939dc2c-5825-4253-a090-6561a3086ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:59.619856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939dc2c-5825-4253-a090-6561a3086ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:59.620132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939dc2c-5825-4253-a090-6561a3086ba1 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:59.621677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939dc2c-5825-4253-a090-6561a3086ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0ddc69c28342409f8a90eaaf72a5e5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:59.623170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939dc2c-5825-4253-a090-6561a3086ba1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:59.625223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 540/1052] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:08:59 2022] GET /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:08:59.632602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:59.758073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:59.844269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bb647-2eea-44e1-a819-57aa2f7d1852 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:59.910671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:59.911693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:59.912149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:59.912603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:59.913999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5, user.id=a3c1468a3ebf4fdbb8d2160f78d43bc9) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:08:59.914552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:59.917722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d155f0-0c47-4705-bcb5-b2d3bf2cfe77 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:59.931580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 513/1053] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:08:59 2022] GET /identity/v3/role_assignments?user.id=a3c1468a3ebf4fdbb8d2160f78d43bc9&scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:00.219882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484fe56-8889-4e8e-9671-36f53e06b6bb None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:00.220850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484fe56-8889-4e8e-9671-36f53e06b6bb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:00.220850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484fe56-8889-4e8e-9671-36f53e06b6bb None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:00.221927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 541/1054] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:00.229538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb037-3f6f-45d0-8dc6-c2ab4604e675 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:00.230031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb037-3f6f-45d0-8dc6-c2ab4604e675 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:00.230521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb037-3f6f-45d0-8dc6-c2ab4604e675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:00.256773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-612eb037-3f6f-45d0-8dc6-c2ab4604e675 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:00.258204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-612eb037-3f6f-45d0-8dc6-c2ab4604e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:00.396418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 514/1055] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:09:00.891394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484fe56-8889-4e8e-9671-36f53e06b6bb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:00.928638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.088544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484fe56-8889-4e8e-9671-36f53e06b6bb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:01.096780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2cd6-0d37-4363-bc24-5855f10bf5c7 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:01.097351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2cd6-0d37-4363-bc24-5855f10bf5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:01.097669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c2cd6-0d37-4363-bc24-5855f10bf5c7 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:01.100239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 515/1056] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:01.108490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:01.109000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:01.109470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:01.137030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:01.138880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:01.153890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:01.154190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:01.154500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:01.154734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] PATH_INFO: `/v3/services/image` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:01.155305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:01.156742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:01.168373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:01.170676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:01.172782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 542/1057] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Sep 1 05:09:00 2022] GET /identity/v3/services/image => generated 86 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:01.176152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:01.241561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.273364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 516/1058] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:01.307888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.334634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01dbfb-9e9b-45d9-a6e9-57db571e0840 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:01.375981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:01.376601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:01.376897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:01.377166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:01.377811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] RBAC: Adding query filter params (name=image) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:01.378163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:01.379584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:01.386690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 543/1059] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:01.392723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:01.521274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1842c-83a3-4f27-ba4e-6875e0548049 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:01.565820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:01.566450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:01.566721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:01.566980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:01.567637 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] RBAC: Adding query filter params (type=image) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:01.567938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:01.569389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:01.576251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 517/1060] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:01.583160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:01.785949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:01.794512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baafff-9334-4cb2-a901-034b6735cf9a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:01.848476 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:01.849166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:01.849439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:01.849710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:01.850395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:01.851825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:01.872192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.874456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.884336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 544/1061] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:09:01.968088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1bc9f-4bf5-46d7-9f7a-654ebfaa7a5a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.026737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d44f7-4bec-4a60-8487-d74ba6898a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:02.027413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d44f7-4bec-4a60-8487-d74ba6898a07 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.027753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d44f7-4bec-4a60-8487-d74ba6898a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.028108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d44f7-4bec-4a60-8487-d74ba6898a07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.049149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d44f7-4bec-4a60-8487-d74ba6898a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3e2d44f7-4bec-4a60-8487-d74ba6898a07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:02.054323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:02.057299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:02.058303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 518/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 1 05:09:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:02.065682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:02.124576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907dfca-06b3-4ff3-9e45-80aa4024a3e9 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.125185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907dfca-06b3-4ff3-9e45-80aa4024a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.125475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907dfca-06b3-4ff3-9e45-80aa4024a3e9 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.127623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 519/1063] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:02.135078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.135540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.135970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.157615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:02.158881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:02.226769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce872b-673b-4728-a639-2818e5a29c19 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.273347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 520/1064] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:02.284846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:02.285891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.286365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.286886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.287877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:02.288431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:02.290187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:02.301399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 545/1065] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:09:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:02.310456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:02.356456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:02.439909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091e53-a5c9-456d-8722-a88e0630cc59 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.483683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:02.484342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.484668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.484941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.498707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:02.500440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:09:02.518678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:02.520578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:09:02.522431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:09:02.522431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:02.522431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:02.525148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 521/1066] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:02.529031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:02.556788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:02.624890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:02.697933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca565d-a415-4c2e-8540-c7e2d4d1e839 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.698771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:02.715439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9e47b-cb36-405f-9e85-2dd3ec9e4c31 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.746250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:02.746901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.747186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.747669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.748105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:02.748406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:02.749923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:02.763931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:02.764823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:02.765244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:02.765641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:02.766147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 546/1067] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:02.772289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:02.786017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:02.792235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:02.793430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:02.797243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 522/1068] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:02.801297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:02.941063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cc099-d964-451a-9313-2cff1287aa77 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.961146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296e746-ba6e-4e11-af9f-b81750b72996 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:02.983886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:03.002057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.002735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.003005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.003275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.013304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.014801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.016974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.017616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.017893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.018162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.018926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:03.019229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.020670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.038557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 523/1069] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:03.040604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:09:03.041687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:03.042661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:09:03.043664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:03.044734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 547/1070] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:09:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:03.052337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.065341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:03.190902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a510b8-9d5f-42c5-8a31-a7a51a90e608 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:03.210986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6303a0-2bce-42bb-9c5f-0611bc071250 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:03.246940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.247605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.247901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.248151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] PATH_INFO: `/v3/users/a3c1468a3ebf4fdbb8d2160f78d43bc9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.250338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c1468a3ebf4fdbb8d2160f78d43bc9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.252350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.260748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 524/1071] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:03 2022] GET /identity/v3/users/a3c1468a3ebf4fdbb8d2160f78d43bc9 => generated 285 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:03.261750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.264601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.265533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.265942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.266387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.267613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:03.267974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.269563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.293411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 548/1072] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:09:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:03.300580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.356668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:03.375205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:03.407124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe50f45-fa61-49f3-855a-28f2e5de4537 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:03.458878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda9fa7-b570-46ef-b342-34ec98c957c2 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:03.465722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.467237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.467951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.468702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.470822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0ddc69c28342409f8a90eaaf72a5e5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.473520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.484958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 525/1073] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:03 2022] GET /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5 => generated 311 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:03.486572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.504462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.505362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.505827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.506568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.520403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.522379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:09:03.542234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:03.545068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:09:03.547810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:09:03.547810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:03.547810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:03.551180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 549/1074] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:03.552428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.641034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8f382-3328-4871-8320-ad69fddb93e5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:03.680426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:03.693473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.694630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.695099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.695591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5/users/a3c1468a3ebf4fdbb8d2160f78d43bc9/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.697121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbc114-b503-4930-8dd8-175b36262846 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:03.698905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] RBAC: Authorizing `identity:create_grant(project_id=8a0ddc69c28342409f8a90eaaf72a5e5, user_id=a3c1468a3ebf4fdbb8d2160f78d43bc9, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.701381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.723681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 526/1075] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:09:03 2022] PUT /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5/users/a3c1468a3ebf4fdbb8d2160f78d43bc9/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:03.757547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:03.758970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:03.759864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:03.760678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:03.761931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:03.762579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:03.765091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:03.788555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 550/1076] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:03.796478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:03.813953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:03.985547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d5e6-5bc4-4d66-9793-c22505e625ea None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:04.028566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:04.029359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:04.029697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:04.030056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:04.041338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:04.043139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8d8f9e6a-a6ec-44d8-a16f-ebfc7a63ed14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:09:04.057894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:04.059673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:04.061355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 527/1077] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:04.066227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:04.201356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4465-2fbf-4a6f-9618-f9c040af8d5b None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:04.247004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:04.248006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:04.248590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:04.249122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:04.250046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:04.250558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:04.252323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:04.264539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8976-3c7f-4747-85af-dc183027c4ea None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:04.265133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8976-3c7f-4747-85af-dc183027c4ea None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:04.265521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8976-3c7f-4747-85af-dc183027c4ea None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:04.267993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 528/1078] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:04.273773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:04.274070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:04.274384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:04.274813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 551/1079] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:04.284979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:04.303982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:04.305245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:04.316491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:04.404977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:04.425189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 529/1080] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:09:04.464448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6576b-3887-4f95-ac8f-b2cc7a859b9d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:04.532498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:04.533459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:04.533892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:04.534322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a467a7344fff4987967c8655dc2965a1/roles/53cf9f7727ed4e5eb9732b1d5e2653fb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:04.538023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=a467a7344fff4987967c8655dc2965a1, role_id=53cf9f7727ed4e5eb9732b1d5e2653fb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:04.540391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:04.565119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 552/1081] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:09:04 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/a467a7344fff4987967c8655dc2965a1/roles/53cf9f7727ed4e5eb9732b1d5e2653fb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:09:04.709551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:04.852179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88350-86e9-4b45-ad6f-d42e469514f1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:04.920693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:04.920693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:04.920693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:04.921287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:05.050754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:05.060453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:05.061979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:05.220809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 530/1082] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:09:05.223979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:05.313347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:05.363945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f6e2-9709-4b88-8d06-f3fd11ca7162 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:05.430137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:05.431742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:05.432552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:05.433237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:05.454705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:05.457725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-86855e8a-4b73-445a-b815-dccadcd556aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:09:05.487377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:05.489291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:09:05.491061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:09:05.491061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:05.491061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:05.491061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 553/1083] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:05.496814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:05.676529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:05.687218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96455e8-da24-462e-9b76-4fc3b5adf2cb None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:05.752160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:05.753141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:05.753624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:05.754161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:05.755323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:05.755844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:05.758711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ff046-1a20-43be-bb44-13347e4be227 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:05.788662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 531/1084] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:06.088979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed516-c928-4228-9ac4-1969fce3f7ca None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:06.089738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed516-c928-4228-9ac4-1969fce3f7ca None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:06.090074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed516-c928-4228-9ac4-1969fce3f7ca None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:06.092771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 554/1085] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:06.099503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:06.099787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:06.100199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:06.124177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:06.125456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:06.210629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 532/1086] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:06.494679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed516-c928-4228-9ac4-1969fce3f7ca None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:06.661705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed516-c928-4228-9ac4-1969fce3f7ca None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:06.692657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:06.706758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2d8e-6e7d-45dc-a560-badc44ad3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:06.707579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2d8e-6e7d-45dc-a560-badc44ad3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:06.707981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2d8e-6e7d-45dc-a560-badc44ad3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:06.708359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2d8e-6e7d-45dc-a560-badc44ad3dd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:06.723111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d2d8e-6e7d-45dc-a560-badc44ad3dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-090d2d8e-6e7d-45dc-a560-badc44ad3dd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:06.728437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:06.730493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:06.732164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 555/1087] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:06.739532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:06.847579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:06.869355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c56f4-dcc6-4a14-b14c-4f5fa8e8056a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:06.871133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd993a-b55b-4f6a-869c-cc24a32f5807 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:06.871608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd993a-b55b-4f6a-869c-cc24a32f5807 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:06.872067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd993a-b55b-4f6a-869c-cc24a32f5807 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:06.874762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 556/1088] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:06.882704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:06.883153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:06.883842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:06.910466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:06.911159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:06.911441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:06.911743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:06.912444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:06.912901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:06.913200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:06.914380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:06.915245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:06.925094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 533/1089] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:06.931346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.037769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 557/1090] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:09:07.062348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f544d-7a60-45ad-8246-2d7db053aae9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.104649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.105362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.105724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.106086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] PATH_INFO: `/v3/users/a3c1468a3ebf4fdbb8d2160f78d43bc9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.107461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c1468a3ebf4fdbb8d2160f78d43bc9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:07.109092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:07.110913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 534/1091] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:06 2022] GET /identity/v3/users/a3c1468a3ebf4fdbb8d2160f78d43bc9 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:07.117828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.249591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724fa1-5398-47db-8ee1-df2604af8b2f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.267432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:07.292389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.293130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.293441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.293744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.351171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.381371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:07.387005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:07.388825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:07.497412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247927e3-a258-4c41-ab70-d1ac6a7a6459 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.530073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 558/1092] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:09:07.537568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.548772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.549441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.549707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.549982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.564364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:07.565663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:07.570924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:07.572472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:07.573541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 535/1093] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Sep 1 05:09:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:07.580037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.678195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03dc6d-bb8c-4a44-ada1-880cf8525610 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.682239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:07.716138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026b1e-3919-491c-a327-9c4e8c579fae None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.727506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.728587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.728972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.729321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.730710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0ddc69c28342409f8a90eaaf72a5e5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:07.732344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:07.739841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 559/1094] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:07 2022] GET /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5 => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:07.741438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.769955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.770969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.771332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.771692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.772519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:07.772986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:07.775075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:07.786944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 536/1095] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:09:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:07.793548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:07.869125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:07.895694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480df1c-cf46-4f1e-a523-65c9c04ff512 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.939575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ef1f7-f66a-4f85-94b9-8c90d57046aa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:07.943508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.944474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.944936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.945331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.946521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5, user.id=a3c1468a3ebf4fdbb8d2160f78d43bc9) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:07.947588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:07.949843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:07.968734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 560/1096] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:07 2022] GET /identity/v3/role_assignments?user.id=a3c1468a3ebf4fdbb8d2160f78d43bc9&scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:07.984770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:07.985456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:07.985858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:07.986120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:07.995425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:08.002121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:08.003975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:09:08.025260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:08.026680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:09:08.027932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:09:08.027932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:08.027932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:08.027932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 537/1097] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:08.035499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:08.219020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24399c-8ed9-4c04-88c7-f8d7d95b60d3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:08.281021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:08.282046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:08.282513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:08.282968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:08.284135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:08.284672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:08.287320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:08.310855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 561/1098] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:08.317852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:08.489217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e103e-7e61-46af-b447-264800b215e3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:08.555856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:08.556932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:08.557238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:08.557511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:08.567559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:08.569125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:09:08.582994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:08.585151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:09:08.587654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:08.589301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 538/1099] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Sep 1 05:09:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:08.591146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:08.606161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:08.732856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb46d2-04d6-41f0-ba15-f133da7ff236 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:08.775531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:08.776242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:08.776662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:08.777043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:08.777915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:08.778326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:08.779957 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:08.802789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 562/1100] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Sep 1 05:09:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:08.809475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:08.871157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:08.935947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d45e-ee28-422c-a984-754b75985aa2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:08.980775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:08.981515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:08.981850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:08.982182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:09.077002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:09.079797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:09.168932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:09.263950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 539/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:09:09.270153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:09.345802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:09.388643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b60f-3e21-4822-8b42-8205c0319730 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:09.426880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:09.427526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:09.427794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:09.428051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:09.439782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:09.441301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:09:09.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:09.471723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:09:09.472707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:09:09.472707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:09:09.472707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:09.472707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 563/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:09.479872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:09.662909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147d86-fcbb-44f3-a81f-c6ba2253df9c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:09.704226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:09.704927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:09.705243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:09.705494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:09.706214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:09.706520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:09.707938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:09.722165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 540/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:09.728283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:09.849020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e25093-60e9-4f6d-b30d-43077ba5892f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:09.868942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:09.891961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:09.892658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:09.892943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:09.893210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:09.901808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:09.903349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:09:09.916877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:09.918582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:09.919961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 564/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:09.926119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:09.947081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:10.060114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c918e-a31c-4179-9c8f-08738cf6f1f5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:10.101392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:10.102021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:10.102296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:10.102629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:10.104017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:10.104323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:10.105856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3207c0b-2a56-4570-978c-1b4dc665eaef None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:10.120581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 541/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:09:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:10.127350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:10.245929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c52ba-3efb-47be-9ca9-1b0cdfc183bc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:10.287215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:10.287985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:10.288121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:10.288359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:10.289142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] RBAC: Adding query filter params (role.id=53cf9f7727ed4e5eb9732b1d5e2653fb, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=a467a7344fff4987967c8655dc2965a1) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:10.289454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:10.291079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269621f2-b45d-42b8-8837-3503ffc803c2 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:10.298176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 565/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:10 2022] GET /identity/v3/role_assignments?user.id=a467a7344fff4987967c8655dc2965a1&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=53cf9f7727ed4e5eb9732b1d5e2653fb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:10.778448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d36c5-13d3-4b0c-bf9b-7774972ff02b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:10.778759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d36c5-13d3-4b0c-bf9b-7774972ff02b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:10.779239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d36c5-13d3-4b0c-bf9b-7774972ff02b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:10.781758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 542/1107] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:10.790339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:10.790872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:10.791172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:10.822624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:10.824606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:10.887304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:10.933501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 566/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:11.227954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d36c5-13d3-4b0c-bf9b-7774972ff02b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:11.327916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:11.363837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d36c5-13d3-4b0c-bf9b-7774972ff02b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:11.403986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30c4d6-5c31-47eb-ba80-0f87a0cca5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:11.404668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30c4d6-5c31-47eb-ba80-0f87a0cca5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:11.404950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30c4d6-5c31-47eb-ba80-0f87a0cca5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:11.405219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30c4d6-5c31-47eb-ba80-0f87a0cca5d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:11.406452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30c4d6-5c31-47eb-ba80-0f87a0cca5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:11.407951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30c4d6-5c31-47eb-ba80-0f87a0cca5d4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:11.409670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 543/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:11.417397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:11.534658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7f7d2-aeb2-4234-9a1b-dcf5c01cb993 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:11.578110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063fced-c22e-43f6-9bb0-a8869f62b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:11.578701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063fced-c22e-43f6-9bb0-a8869f62b156 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:11.579025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063fced-c22e-43f6-9bb0-a8869f62b156 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:11.579345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063fced-c22e-43f6-9bb0-a8869f62b156 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:11.580057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063fced-c22e-43f6-9bb0-a8869f62b156 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:11.581615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063fced-c22e-43f6-9bb0-a8869f62b156 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:11.606411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 567/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:09:11 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:13.781434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163894e-9323-4990-9148-9b45cf690e63 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:13.782352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163894e-9323-4990-9148-9b45cf690e63 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:13.782352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163894e-9323-4990-9148-9b45cf690e63 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:13.783716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 544/1111] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:13.790390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:13.791236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:13.791392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:13.813285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:13.814518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:13.839936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:13.897570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 568/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:14.175302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163894e-9323-4990-9148-9b45cf690e63 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:14.303262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163894e-9323-4990-9148-9b45cf690e63 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:14.352455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:14.353534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:14.353945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:14.354400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] PATH_INFO: `/v3/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:14.356936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] RBAC: Authorizing `identity:get_role(role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:14.359347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:14.362106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 545/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:14 2022] GET /identity/v3/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 223 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:14.368661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:14.491445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1400351-249b-4cf4-ba2b-bc5d0bf54ae5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:14.534910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:14.535612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:14.535923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:14.536231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] PATH_INFO: `/v3/users/bd68e6ee8f7e44ae8f557ad73f099478` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:14.553639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] RBAC: Authorizing `identity:get_user(user_id=bd68e6ee8f7e44ae8f557ad73f099478)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:14.554796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:14.557072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 569/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:14 2022] GET /identity/v3/users/bd68e6ee8f7e44ae8f557ad73f099478 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:14.563381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:14.573641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:14.708396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9f575-4685-4a69-838f-2310a76e8a92 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:14.760639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:14.761691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:14.762170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:14.762634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:14.884121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:14.885671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:14.894854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:15.003135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 546/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:09:15.010103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:15.030683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:15.135320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6a54-04e3-4f79-9542-ac741ef6e394 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:15.175776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91879841-d965-4956-a443-0c581d76e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:15.176442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91879841-d965-4956-a443-0c581d76e979 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:15.176752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91879841-d965-4956-a443-0c581d76e979 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:15.177027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91879841-d965-4956-a443-0c581d76e979 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:15.178427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91879841-d965-4956-a443-0c581d76e979 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0ddc69c28342409f8a90eaaf72a5e5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:15.179928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91879841-d965-4956-a443-0c581d76e979 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:15.181903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 570/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:15 2022] GET /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:15.188971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:15.308365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e179a-00ac-44bc-b2e5-6a5d4b2f0884 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:15.318093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:15.350501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:15.351111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:15.351387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:15.351654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:15.352792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] RBAC: Adding query filter params (role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5, user.id=bd68e6ee8f7e44ae8f557ad73f099478) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:15.353280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:15.355275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf1ba0-0477-4596-9e7c-2a64b3b17516 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:15.362094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 547/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:15 2022] GET /identity/v3/role_assignments?user.id=bd68e6ee8f7e44ae8f557ad73f099478&scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:17.327732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8f6ab-199a-421d-847c-a2d9641793cb None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:17.328339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8f6ab-199a-421d-847c-a2d9641793cb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:17.328339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8f6ab-199a-421d-847c-a2d9641793cb None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:17.329652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 571/1118] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:17.335736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:17.336357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:17.336357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:17.356954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:17.358238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:17.440255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 548/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:17.706848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8f6ab-199a-421d-847c-a2d9641793cb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:17.808235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:17.830860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8f6ab-199a-421d-847c-a2d9641793cb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:17.871412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:17.872127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:17.872470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:17.872802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] PATH_INFO: `/v3/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:17.874381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] RBAC: Authorizing `identity:get_role(role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:17.875840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:17.877346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 572/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:17 2022] GET /identity/v3/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:17.885428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:18.001926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:18.005537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08886fe2-318c-44ca-bfe3-6e13d15b086b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:18.048349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:18.049080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:18.049400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:18.049774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] PATH_INFO: `/v3/users/bd68e6ee8f7e44ae8f557ad73f099478` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:18.051065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] RBAC: Authorizing `identity:get_user(user_id=bd68e6ee8f7e44ae8f557ad73f099478)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:18.052728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:18.054459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 549/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:17 2022] GET /identity/v3/users/bd68e6ee8f7e44ae8f557ad73f099478 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:18.061467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:18.180644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2d46-5c99-48cd-a983-2cf29b06c01d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:18.221592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad6491-b2e3-41e8-b448-bed5e52aea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:18.222237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad6491-b2e3-41e8-b448-bed5e52aea17 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:18.222512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad6491-b2e3-41e8-b448-bed5e52aea17 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:18.222780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad6491-b2e3-41e8-b448-bed5e52aea17 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:18.224013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad6491-b2e3-41e8-b448-bed5e52aea17 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0ddc69c28342409f8a90eaaf72a5e5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:18.225543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad6491-b2e3-41e8-b448-bed5e52aea17 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:18.227319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 573/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:18 2022] GET /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:18.234919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:18.402627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a4ab-fe82-48d5-bd89-934c81385a1c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:18.461579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e456a-392f-4086-8d29-1f5cfde9e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:18.462748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e456a-392f-4086-8d29-1f5cfde9e544 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:18.463249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e456a-392f-4086-8d29-1f5cfde9e544 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:18.463740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e456a-392f-4086-8d29-1f5cfde9e544 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5/users/bd68e6ee8f7e44ae8f557ad73f099478/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:18.467598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e456a-392f-4086-8d29-1f5cfde9e544 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a0ddc69c28342409f8a90eaaf72a5e5, user_id=bd68e6ee8f7e44ae8f557ad73f099478, role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:18.470334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e456a-392f-4086-8d29-1f5cfde9e544 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:18.494748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 550/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:09:18 2022] PUT /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5/users/bd68e6ee8f7e44ae8f557ad73f099478/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:20.529177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e499c-b9fc-4e64-a39c-7056833ebd22 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:20.529801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e499c-b9fc-4e64-a39c-7056833ebd22 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:20.529801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e499c-b9fc-4e64-a39c-7056833ebd22 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:20.531243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 574/1124] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:20.537509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:20.538384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:20.538384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:20.558554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:20.559784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:20.585697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:20.648378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 551/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:20.916134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e499c-b9fc-4e64-a39c-7056833ebd22 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:20.938215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:21.054816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e499c-b9fc-4e64-a39c-7056833ebd22 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:21.095886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:21.096839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:21.097203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:21.097471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] PATH_INFO: `/v3/roles/c4f58c0e1d28408db0615bf553e5dfbb` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:21.099360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] RBAC: Authorizing `identity:get_role(role_id=c4f58c0e1d28408db0615bf553e5dfbb)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:21.100817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:21.102255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 575/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:20 2022] GET /identity/v3/roles/c4f58c0e1d28408db0615bf553e5dfbb => generated 223 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:21.112148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:21.254472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a7a0-9145-4500-998b-a53094696df0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:21.303683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:21.304332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:21.304605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:21.304907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] PATH_INFO: `/v3/users/bd68e6ee8f7e44ae8f557ad73f099478` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:21.306323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd68e6ee8f7e44ae8f557ad73f099478)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:21.307779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:21.309437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 552/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:21 2022] GET /identity/v3/users/bd68e6ee8f7e44ae8f557ad73f099478 => generated 286 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:21.318176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:21.416005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:21.434465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc93e9-206f-4ea9-9149-0fe780cc1d26 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:21.475068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:21.475926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:21.476247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:21.476562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:21.553684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:21.555080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:21.656101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:21.674500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 576/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:09:21.681978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:21.714439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:21.809606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8387e-c260-416f-8690-3b2f845e78f4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:21.847767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba40d-c467-4e33-8c05-411ae5403b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:21.848417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba40d-c467-4e33-8c05-411ae5403b37 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:21.848729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba40d-c467-4e33-8c05-411ae5403b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:21.849002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba40d-c467-4e33-8c05-411ae5403b37 None admin] PATH_INFO: `/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:21.850176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba40d-c467-4e33-8c05-411ae5403b37 None admin] RBAC: Authorizing `identity:get_project(project_id=8a0ddc69c28342409f8a90eaaf72a5e5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:21.851642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba40d-c467-4e33-8c05-411ae5403b37 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:21.853658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 553/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:21 2022] GET /identity/v3/projects/8a0ddc69c28342409f8a90eaaf72a5e5 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:21.863497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:21.985061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f9f10-1408-4e22-9a4f-bc5851551a02 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:22.036873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:22.037866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:22.038306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:22.038731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:22.040263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] RBAC: Adding query filter params (role.id=c4f58c0e1d28408db0615bf553e5dfbb, scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5, user.id=bd68e6ee8f7e44ae8f557ad73f099478) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:22.040597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:22.043310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba445d-e8da-4756-86ef-0471a677505c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:22.055055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 577/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:21 2022] GET /identity/v3/role_assignments?user.id=bd68e6ee8f7e44ae8f557ad73f099478&scope.project.id=8a0ddc69c28342409f8a90eaaf72a5e5&role.id=c4f58c0e1d28408db0615bf553e5dfbb => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:24.156785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e39f-56be-4396-8aea-a2b8faeceac2 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:24.157389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e39f-56be-4396-8aea-a2b8faeceac2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:24.157389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e39f-56be-4396-8aea-a2b8faeceac2 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:24.158852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 554/1131] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:24.166850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:24.167481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:24.167481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:24.188229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:24.189511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:24.245800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:24.272950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 578/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:09:24.558207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e39f-56be-4396-8aea-a2b8faeceac2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:24.673155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:24.683060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e39f-56be-4396-8aea-a2b8faeceac2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:24.723567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53856-cd69-45ff-b2ee-f02f32b8371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:24.724259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53856-cd69-45ff-b2ee-f02f32b8371e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:24.724611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53856-cd69-45ff-b2ee-f02f32b8371e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:24.724987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53856-cd69-45ff-b2ee-f02f32b8371e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:24.726280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53856-cd69-45ff-b2ee-f02f32b8371e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:24.727831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53856-cd69-45ff-b2ee-f02f32b8371e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:24.729571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 555/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:24.735905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:24.860995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c0fd9-3956-47e9-b8b5-92edf92d152f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:24.902891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c2af-6014-4c13-977a-165e678490c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:24.903541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c2af-6014-4c13-977a-165e678490c4 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:24.903850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c2af-6014-4c13-977a-165e678490c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:24.904147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c2af-6014-4c13-977a-165e678490c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:24.904871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670c2af-6014-4c13-977a-165e678490c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:24.906392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670c2af-6014-4c13-977a-165e678490c4 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:24.940608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 579/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:09:24 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:27.084443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c149-337a-4648-912b-1079e347a9f6 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:27.085086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c149-337a-4648-912b-1079e347a9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:27.085086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c149-337a-4648-912b-1079e347a9f6 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:27.086793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 556/1135] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:27.093049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:27.093827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:27.093827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:27.120330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:27.122405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:27.171537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:27.222051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 580/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:27.505091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c149-337a-4648-912b-1079e347a9f6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:27.630987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c149-337a-4648-912b-1079e347a9f6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:27.672480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72243d-476d-48d2-98c0-d1171bdfbe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:27.673186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72243d-476d-48d2-98c0-d1171bdfbe4f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:27.673468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72243d-476d-48d2-98c0-d1171bdfbe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:27.673739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72243d-476d-48d2-98c0-d1171bdfbe4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:27.675043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72243d-476d-48d2-98c0-d1171bdfbe4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:27.676548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72243d-476d-48d2-98c0-d1171bdfbe4f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:27.678286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 557/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:09:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:27.685145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:27.799794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155361ab-1086-4de3-8a6e-60a691757be0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:27.838239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf184c-ff15-4149-9c2a-854630af0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:27.838861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf184c-ff15-4149-9c2a-854630af0a3c None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:27.839135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf184c-ff15-4149-9c2a-854630af0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:27.839402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf184c-ff15-4149-9c2a-854630af0a3c None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:27.840071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf184c-ff15-4149-9c2a-854630af0a3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:27.841567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf184c-ff15-4149-9c2a-854630af0a3c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:27.865721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 581/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:09:27 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:30.615159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0e6d9-e5d5-446e-ac7a-794880b2fe09 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:30.615781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0e6d9-e5d5-446e-ac7a-794880b2fe09 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:30.615781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0e6d9-e5d5-446e-ac7a-794880b2fe09 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:30.617252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 558/1139] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:30.623565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:30.624155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:30.624259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:30.646720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:30.647966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:30.665746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:30.729075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 582/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:31.005633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0e6d9-e5d5-446e-ac7a-794880b2fe09 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:31.040289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:31.126756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0e6d9-e5d5-446e-ac7a-794880b2fe09 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:31.170059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:31.170785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:31.171063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:31.171332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:31.185468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:31.190373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:31.192217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:31.193531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 559/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:31.199596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:31.323051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3de65e-e55d-449b-83b0-1770fe87a56d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:31.363742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:31.364386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:31.364671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:31.364944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:31.365630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:31.365922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:31.367380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:31.377859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 583/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:31.385714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:31.498026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:31.511273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf6d80-2082-4a10-8bff-db1501088c5b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:31.555347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:31.556008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:31.556292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:31.556565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] PATH_INFO: `/v3/users/915d770eeebb43a1b7085167a3f6d962` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:31.573503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=915d770eeebb43a1b7085167a3f6d962)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:31.575009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:31.576937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 560/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:31 2022] GET /identity/v3/users/915d770eeebb43a1b7085167a3f6d962 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:31.583620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:31.600144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:31.711396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4683e-5382-417d-a68a-e24c4d10076e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:31.751020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:31.751655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:31.751904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:31.752194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:31.830506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:31.831913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:31.846127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:31.950726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 584/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:09:31.957207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:32.077347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00306e2-58d4-4aa4-9c2c-04a4ac179aa2 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:32.117098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2645228-0ba0-4426-ae10-99032cf37f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:32.117729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645228-0ba0-4426-ae10-99032cf37f66 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:32.118049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645228-0ba0-4426-ae10-99032cf37f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:32.118363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645228-0ba0-4426-ae10-99032cf37f66 None admin] PATH_INFO: `/v3/projects/10329414052b486493a2c32a9eee36f7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:32.119823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2645228-0ba0-4426-ae10-99032cf37f66 None admin] RBAC: Authorizing `identity:get_project(project_id=10329414052b486493a2c32a9eee36f7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:32.121459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2645228-0ba0-4426-ae10-99032cf37f66 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:32.123246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 561/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:31 2022] GET /identity/v3/projects/10329414052b486493a2c32a9eee36f7 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:32.130062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:32.244843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df919109-1d8d-4764-934c-9629f0c503de None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:32.258489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:32.288397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:32.289130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:32.289402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:32.289684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:32.290420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=10329414052b486493a2c32a9eee36f7, user.id=915d770eeebb43a1b7085167a3f6d962) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:32.290724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:32.292194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93495-06c5-4169-ad8a-353a573a92d1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:32.298755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 585/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:32 2022] GET /identity/v3/role_assignments?user.id=915d770eeebb43a1b7085167a3f6d962&scope.project.id=10329414052b486493a2c32a9eee36f7&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:34.337021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554cae-596e-4b43-b876-d2f426ec246a None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:34.337697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554cae-596e-4b43-b876-d2f426ec246a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:34.337697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554cae-596e-4b43-b876-d2f426ec246a None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:34.338986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 562/1147] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:34.345317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:34.346150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:34.346150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:34.367238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:34.368596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:34.453681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 586/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:34.735874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554cae-596e-4b43-b876-d2f426ec246a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:34.756094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:34.856316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554cae-596e-4b43-b876-d2f426ec246a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:34.895851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:34.896502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:34.896808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:34.897078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:34.909799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:34.915164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:34.917006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:34.918770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 563/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:34.925996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:35.043064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f093d8b-40f2-45d7-9ac7-eb53a0efc7b3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:35.045733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:35.083449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:35.084071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:35.084347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:35.084614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:35.085325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:35.085753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:35.087195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:35.097552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 587/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:35.104660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:35.205672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:35.233127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23930a-c9c3-4a56-8b76-4e87b9096ffa None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:35.271887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:35.272570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:35.272882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:35.273251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] PATH_INFO: `/v3/users/915d770eeebb43a1b7085167a3f6d962` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:35.274770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] RBAC: Authorizing `identity:get_user(user_id=915d770eeebb43a1b7085167a3f6d962)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:35.276267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:35.278003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 564/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:35 2022] GET /identity/v3/users/915d770eeebb43a1b7085167a3f6d962 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:35.284454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:35.405635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b9c-1880-4696-abbc-72f7fdcc4291 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:35.446014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd015e98-2ecb-4ff6-a96c-f06a42794eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:35.446670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd015e98-2ecb-4ff6-a96c-f06a42794eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:35.446943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd015e98-2ecb-4ff6-a96c-f06a42794eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:35.447210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd015e98-2ecb-4ff6-a96c-f06a42794eb6 None admin] PATH_INFO: `/v3/projects/10329414052b486493a2c32a9eee36f7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:35.448456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd015e98-2ecb-4ff6-a96c-f06a42794eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=10329414052b486493a2c32a9eee36f7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:35.449980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd015e98-2ecb-4ff6-a96c-f06a42794eb6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:35.451758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 588/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:35 2022] GET /identity/v3/projects/10329414052b486493a2c32a9eee36f7 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:35.461192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:35.598825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146bf9-eb87-445b-8ee0-f595ed10ef98 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:35.638502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eac4a-79b2-47aa-96e2-765e0c72e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:35.639190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eac4a-79b2-47aa-96e2-765e0c72e036 None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:35.639467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eac4a-79b2-47aa-96e2-765e0c72e036 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:35.639738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eac4a-79b2-47aa-96e2-765e0c72e036 None admin] PATH_INFO: `/v3/projects/10329414052b486493a2c32a9eee36f7/users/915d770eeebb43a1b7085167a3f6d962/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:35.641819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517eac4a-79b2-47aa-96e2-765e0c72e036 None admin] RBAC: Authorizing `identity:create_grant(project_id=10329414052b486493a2c32a9eee36f7, user_id=915d770eeebb43a1b7085167a3f6d962, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:35.643283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517eac4a-79b2-47aa-96e2-765e0c72e036 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:35.660941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 565/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:09:35 2022] PUT /identity/v3/projects/10329414052b486493a2c32a9eee36f7/users/915d770eeebb43a1b7085167a3f6d962/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:37.693171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0063e-c7d2-44b8-97be-b313a4d03c93 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:37.693913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0063e-c7d2-44b8-97be-b313a4d03c93 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:37.693913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0063e-c7d2-44b8-97be-b313a4d03c93 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:37.695225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 589/1154] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:37.702382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:37.703076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:37.703076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:37.712170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:37.727689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:37.729161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:37.817652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 566/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:38.112375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0063e-c7d2-44b8-97be-b313a4d03c93 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:38.154680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:38.231649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0063e-c7d2-44b8-97be-b313a4d03c93 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:38.271528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:38.272185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:38.272461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:38.272776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:38.286544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:38.291749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:38.293635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:38.295265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 590/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:38.299752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:38.420058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84523-4d78-4c7a-b655-22fd33d5fdc1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:38.459930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:38.460756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:38.461041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:38.461318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:38.462043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:38.462350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:38.463762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:38.465548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:38.474660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 567/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:38.481456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:38.607579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:38.618432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4eacf-e62d-4170-9709-df41d59126e9 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:38.678383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:38.679428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:38.679884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:38.680339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] PATH_INFO: `/v3/users/915d770eeebb43a1b7085167a3f6d962` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:38.682425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] RBAC: Authorizing `identity:get_user(user_id=915d770eeebb43a1b7085167a3f6d962)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:38.685135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:38.688104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 591/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:38 2022] GET /identity/v3/users/915d770eeebb43a1b7085167a3f6d962 => generated 286 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:38.695085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:38.813600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303a810-c256-4fbb-bdeb-4af1158b4f1f None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:38.849820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:38.850429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:38.850705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:38.851109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:38.926872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:38.935175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:38.936777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:39.052449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 568/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:09:39.059762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:39.182848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5bd8-ef82-4fec-8de1-ea90ed39a79e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:39.225417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b513f-a7a7-459c-8167-807a2c41682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:39.226086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b513f-a7a7-459c-8167-807a2c41682b None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:39.226385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b513f-a7a7-459c-8167-807a2c41682b None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:39.226651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b513f-a7a7-459c-8167-807a2c41682b None admin] PATH_INFO: `/v3/projects/10329414052b486493a2c32a9eee36f7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:39.227912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b513f-a7a7-459c-8167-807a2c41682b None admin] RBAC: Authorizing `identity:get_project(project_id=10329414052b486493a2c32a9eee36f7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:39.229422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b513f-a7a7-459c-8167-807a2c41682b None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:39.231144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 592/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:39 2022] GET /identity/v3/projects/10329414052b486493a2c32a9eee36f7 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:39.237919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:39.348389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:39.355332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604cff-2678-4df3-9d6b-d9ce1a61ce13 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:39.397545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:39.398620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:39.398923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:39.399309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:39.400563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=10329414052b486493a2c32a9eee36f7, user.id=915d770eeebb43a1b7085167a3f6d962) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:39.401158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:39.403758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bb52-b8c8-4e1e-ba99-0801a555eb21 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:39.413388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 569/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:39 2022] GET /identity/v3/role_assignments?user.id=915d770eeebb43a1b7085167a3f6d962&scope.project.id=10329414052b486493a2c32a9eee36f7&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:41.535003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb31bc-4447-4fc9-ab42-6e7f245d1994 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:41.535835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb31bc-4447-4fc9-ab42-6e7f245d1994 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:41.535835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb31bc-4447-4fc9-ab42-6e7f245d1994 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:41.537142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 593/1162] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:41.543126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:41.543696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:41.543696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:41.564430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:41.565698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:41.652412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 570/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:41.922740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb31bc-4447-4fc9-ab42-6e7f245d1994 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:41.957828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:42.043341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb31bc-4447-4fc9-ab42-6e7f245d1994 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:42.084365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:42.085083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:42.085646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:42.085918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:42.163732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:42.165236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:42.198400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:42.285899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 594/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:09:42.293762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:42.456400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:42.469865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96d218-8890-4468-a3fe-52f6dab7ed49 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:42.510874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:42.511568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:42.511889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:42.512204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:42.520073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:42.521725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5a6a43ed-4e0c-47b1-bfb4-866f64543dfa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:42.534964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:42.536912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:09:42.537894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 571/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:09:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:42.543451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:42.658847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37b57f-e14d-43ba-941c-775f6c237803 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:42.692409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:42.699403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:42.700039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:42.700317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:42.700588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:42.701302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:42.701631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:42.703037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b137ef-5a18-483c-9c29-2ca9ff1b208d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:42.711542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 595/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Sep 1 05:09:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:44.767885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7772a8-1ce9-48b0-9c98-d6df33bec331 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:44.768471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7772a8-1ce9-48b0-9c98-d6df33bec331 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:44.768877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7772a8-1ce9-48b0-9c98-d6df33bec331 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:44.771516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 572/1167] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:44.777916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c714-f41e-4ab1-8195-d2977eb16531 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:44.778522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c714-f41e-4ab1-8195-d2977eb16531 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:44.778522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c714-f41e-4ab1-8195-d2977eb16531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:44.799751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ffa1c714-f41e-4ab1-8195-d2977eb16531 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:44.801006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ffa1c714-f41e-4ab1-8195-d2977eb16531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:44.878858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 596/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:45.394237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7772a8-1ce9-48b0-9c98-d6df33bec331 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:45.517163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7772a8-1ce9-48b0-9c98-d6df33bec331 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:45.556830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f581005-d0f2-424c-a7bd-a05df9e9a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:45.557466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f581005-d0f2-424c-a7bd-a05df9e9a698 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:45.557746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f581005-d0f2-424c-a7bd-a05df9e9a698 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:45.558017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f581005-d0f2-424c-a7bd-a05df9e9a698 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:45.558706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f581005-d0f2-424c-a7bd-a05df9e9a698 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:45.560112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f581005-d0f2-424c-a7bd-a05df9e9a698 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:45.580684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 573/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Thu Sep 1 05:09:45 2022] POST /identity/v3/domains => generated 267 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:47.633491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c327d-3f49-4c24-b36e-9bebd12ffd98 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.634099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c327d-3f49-4c24-b36e-9bebd12ffd98 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.634099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c327d-3f49-4c24-b36e-9bebd12ffd98 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.635389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 597/1170] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:47.641051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.643715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.643715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.661587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.662825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.666548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:47.744587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 574/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:48.011387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c327d-3f49-4c24-b36e-9bebd12ffd98 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.152723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c327d-3f49-4c24-b36e-9bebd12ffd98 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.183471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.197251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27942a74-d992-40ab-b0bb-9f0b068b556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.197921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942a74-d992-40ab-b0bb-9f0b068b556a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.198190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942a74-d992-40ab-b0bb-9f0b068b556a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.198453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942a74-d992-40ab-b0bb-9f0b068b556a None admin] PATH_INFO: `/v3/domains/ddca5b7fe1d746b4bd6ec9d5bea26a2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.211979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27942a74-d992-40ab-b0bb-9f0b068b556a None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddca5b7fe1d746b4bd6ec9d5bea26a2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.213532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27942a74-d992-40ab-b0bb-9f0b068b556a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.215331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 598/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/domains/ddca5b7fe1d746b4bd6ec9d5bea26a2f => generated 267 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.224654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.350637 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53301e-be34-4904-9e52-c7a74a7dc51d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.394879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfb970-af84-4550-ad56-e52bbeb33099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.395510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb970-af84-4550-ad56-e52bbeb33099 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.395795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb970-af84-4550-ad56-e52bbeb33099 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.396066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb970-af84-4550-ad56-e52bbeb33099 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.396801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfb970-af84-4550-ad56-e52bbeb33099 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.398455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfb970-af84-4550-ad56-e52bbeb33099 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.411587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.431749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 575/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:50.539628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b810afe-7352-46a3-99c6-5ec1cdb85b06 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.540328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b810afe-7352-46a3-99c6-5ec1cdb85b06 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.540328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b810afe-7352-46a3-99c6-5ec1cdb85b06 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.541588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 599/1174] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:50.550147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c982d-7229-433a-825c-284e598f527c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.551010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c982d-7229-433a-825c-284e598f527c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.551010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c982d-7229-433a-825c-284e598f527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.571307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8c2c982d-7229-433a-825c-284e598f527c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.572537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8c2c982d-7229-433a-825c-284e598f527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.649704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 576/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:50.939069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b810afe-7352-46a3-99c6-5ec1cdb85b06 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:51.058296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b810afe-7352-46a3-99c6-5ec1cdb85b06 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:51.100260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2151f-f2b3-429f-9c3c-cbba31a780ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:51.100950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2151f-f2b3-429f-9c3c-cbba31a780ec None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:51.101347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2151f-f2b3-429f-9c3c-cbba31a780ec None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:51.101624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2151f-f2b3-429f-9c3c-cbba31a780ec None admin] PATH_INFO: `/v3/domains/ddca5b7fe1d746b4bd6ec9d5bea26a2f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:51.102874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2151f-f2b3-429f-9c3c-cbba31a780ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddca5b7fe1d746b4bd6ec9d5bea26a2f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:51.104364 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2151f-f2b3-429f-9c3c-cbba31a780ec None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:51.106035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 600/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/domains/ddca5b7fe1d746b4bd6ec9d5bea26a2f => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:51.112299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c982d-7229-433a-825c-284e598f527c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:51.243995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c982d-7229-433a-825c-284e598f527c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:51.290745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:51.314331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1d94-a0ff-4bb9-8055-35fd8839609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:51.315367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1d94-a0ff-4bb9-8055-35fd8839609f None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:51.315859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1d94-a0ff-4bb9-8055-35fd8839609f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:51.316340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1d94-a0ff-4bb9-8055-35fd8839609f None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:51.317654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1d94-a0ff-4bb9-8055-35fd8839609f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:51.320732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1d94-a0ff-4bb9-8055-35fd8839609f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:51.355018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 577/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:09:51 2022] POST /identity/v3/users => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:53.487348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f58c7-da39-4673-aaad-6c408c6b9f3c None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:53.487983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f58c7-da39-4673-aaad-6c408c6b9f3c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:53.487983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f58c7-da39-4673-aaad-6c408c6b9f3c None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:53.489289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 601/1178] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:53.495584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159506-899c-4095-99d7-364da526b342 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:53.496213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159506-899c-4095-99d7-364da526b342 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:53.496213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159506-899c-4095-99d7-364da526b342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:53.517629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-07159506-899c-4095-99d7-364da526b342 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:53.518884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-07159506-899c-4095-99d7-364da526b342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:53.600726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 578/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:53.884263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f58c7-da39-4673-aaad-6c408c6b9f3c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:53.946872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:54.002179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f58c7-da39-4673-aaad-6c408c6b9f3c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:54.043138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:54.044210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:54.044730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:54.045186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:54.065091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:54.073990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:54.075367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:54.076506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 602/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:09:54.086564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159506-899c-4095-99d7-364da526b342 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:54.257898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159506-899c-4095-99d7-364da526b342 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:54.269397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:54.299907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:54.300592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:54.300966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:54.301301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:54.302051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:54.302407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:54.304212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:54.314413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 579/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:54.321078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:54.500495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7dc3b-3312-49ba-a83a-32cd6830c0f6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:54.517345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:54.543670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:54.544381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:54.544740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:54.545056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] PATH_INFO: `/v3/users/86744ee89b4b45bc9032680969cc2aad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:54.564169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] RBAC: Authorizing `identity:get_user(user_id=86744ee89b4b45bc9032680969cc2aad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:54.566369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:54.568292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 603/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:54 2022] GET /identity/v3/users/86744ee89b4b45bc9032680969cc2aad => generated 311 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:54.575325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:54.697266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b706f31-1d9e-475e-ade5-35ea55fe771a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:54.741978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:54.742663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:54.742943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:54.743216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:54.792561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:54.828183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:54.829698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:54.960847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 580/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:09:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:09:54.967439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:55.105658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790b07f-c902-4b03-9eb0-ca1ea72b9062 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:55.167509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f749-68cc-4b02-9768-f7cf9f0656d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:55.168581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f749-68cc-4b02-9768-f7cf9f0656d9 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:55.169087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f749-68cc-4b02-9768-f7cf9f0656d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:55.169543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f749-68cc-4b02-9768-f7cf9f0656d9 None admin] PATH_INFO: `/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:55.171543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f749-68cc-4b02-9768-f7cf9f0656d9 None admin] RBAC: Authorizing `identity:get_project(project_id=898c59e0eb63439d9ef5e544ec3b4d8c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:55.174270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f749-68cc-4b02-9768-f7cf9f0656d9 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:55.177413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 604/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:54 2022] GET /identity/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c => generated 361 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:55.187127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:55.270864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:55.311275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c226-76ea-4d65-8080-eb722a003fa4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:55.352349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:55.353010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:55.353291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:55.353563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:55.354306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=898c59e0eb63439d9ef5e544ec3b4d8c, user.id=86744ee89b4b45bc9032680969cc2aad) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:55.354615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:55.356197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da558c-37ee-4108-9fe8-c88fc7216bb2 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:55.362512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 581/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:09:55 2022] GET /identity/v3/role_assignments?user.id=86744ee89b4b45bc9032680969cc2aad&scope.project.id=898c59e0eb63439d9ef5e544ec3b4d8c&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:57.427085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbd5f6-15be-40c5-889f-09d5661db21e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.427699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbd5f6-15be-40c5-889f-09d5661db21e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.427699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbd5f6-15be-40c5-889f-09d5661db21e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.429021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 605/1186] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:57.435193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.435734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.435734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.456900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:57.458142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.537178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 582/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:09:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:09:57.817940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbd5f6-15be-40c5-889f-09d5661db21e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.870734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:57.944434 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbd5f6-15be-40c5-889f-09d5661db21e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.985486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.986139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.986409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.986675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.999823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:09:58.005244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:09:58.006827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:09:58.007940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 606/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:09:58.013216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.087510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:58.128901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d94c2-842b-44b7-9d4a-47257d194924 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.168353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.169222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.169550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.169860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.170610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:58.170958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.172524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.182660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 583/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:58.189184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.301756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:58.306715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d4f5-a141-4f97-87c6-ba1907561299 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.346320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.346877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.347153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.347495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] PATH_INFO: `/v3/users/86744ee89b4b45bc9032680969cc2aad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.348755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] RBAC: Authorizing `identity:get_user(user_id=86744ee89b4b45bc9032680969cc2aad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.350280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.352408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 607/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:09:58 2022] GET /identity/v3/users/86744ee89b4b45bc9032680969cc2aad => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:58.359331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.480615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a35c-e106-48f3-b1c6-69e7402261e4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.511874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:58.521983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebceac-8e9b-41f5-81b9-964f05987c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.522890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebceac-8e9b-41f5-81b9-964f05987c1f None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.523301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebceac-8e9b-41f5-81b9-964f05987c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.523578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebceac-8e9b-41f5-81b9-964f05987c1f None admin] PATH_INFO: `/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.524860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebceac-8e9b-41f5-81b9-964f05987c1f None admin] RBAC: Authorizing `identity:get_project(project_id=898c59e0eb63439d9ef5e544ec3b4d8c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.526343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebceac-8e9b-41f5-81b9-964f05987c1f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.528057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 584/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:09:58 2022] GET /identity/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:58.534496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.654542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520987de-0595-4aa7-856d-f4d6bc38f1fc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.692695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435993f4-9ee2-4fab-b274-62af16043a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.693368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435993f4-9ee2-4fab-b274-62af16043a5c None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.693670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435993f4-9ee2-4fab-b274-62af16043a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.693989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435993f4-9ee2-4fab-b274-62af16043a5c None admin] PATH_INFO: `/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c/users/86744ee89b4b45bc9032680969cc2aad/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.696011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435993f4-9ee2-4fab-b274-62af16043a5c None admin] RBAC: Authorizing `identity:create_grant(project_id=898c59e0eb63439d9ef5e544ec3b4d8c, user_id=86744ee89b4b45bc9032680969cc2aad, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.697498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435993f4-9ee2-4fab-b274-62af16043a5c None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.714560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 608/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:09:58 2022] PUT /identity/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c/users/86744ee89b4b45bc9032680969cc2aad/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:00.712908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd1a4-c7b1-46dd-9ae2-43a65fe5950b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.713807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd1a4-c7b1-46dd-9ae2-43a65fe5950b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.713807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd1a4-c7b1-46dd-9ae2-43a65fe5950b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.714807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 585/1193] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:10:00.720912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.721711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.721711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.742219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:00.743482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:00.769928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:00.826779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 609/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:10:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:10:01.102129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd1a4-c7b1-46dd-9ae2-43a65fe5950b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.221279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd1a4-c7b1-46dd-9ae2-43a65fe5950b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.263301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.264007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.264330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.264672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.278162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:10:01.283728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:10:01.285680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:10:01.287290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 586/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:10:01.294285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.412147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b87a-9fc5-42c2-ba38-9455bbf3d029 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.462578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.463222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.463498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.463762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.464440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:01.464776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.466194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.476652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 610/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:01.487051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.588394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:01.644344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f71e-59de-4396-b3f9-303ad6cd728a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.688102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.688792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.689065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.689359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] PATH_INFO: `/v3/users/86744ee89b4b45bc9032680969cc2aad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.690573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] RBAC: Authorizing `identity:get_user(user_id=86744ee89b4b45bc9032680969cc2aad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.692055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.693989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 587/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Sep 1 05:10:01 2022] GET /identity/v3/users/86744ee89b4b45bc9032680969cc2aad => generated 311 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:01.701252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.725029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:01.823400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999c07-6ae3-4410-8911-7c2cc8677dad None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.862809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.863421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.863739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.864054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.942921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.945474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.967191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:02.071311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 611/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:10:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:10:02.077980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.192901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0a08a-920c-4d86-bb33-1d873e9b328a None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.219768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:02.233227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4f99a-50bf-4d37-a743-610ccc9aea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.233874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4f99a-50bf-4d37-a743-610ccc9aea4c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.234149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4f99a-50bf-4d37-a743-610ccc9aea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.234417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4f99a-50bf-4d37-a743-610ccc9aea4c None admin] PATH_INFO: `/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.235624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4f99a-50bf-4d37-a743-610ccc9aea4c None admin] RBAC: Authorizing `identity:get_project(project_id=898c59e0eb63439d9ef5e544ec3b4d8c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.237107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4f99a-50bf-4d37-a743-610ccc9aea4c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.238767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 588/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Sep 1 05:10:02 2022] GET /identity/v3/projects/898c59e0eb63439d9ef5e544ec3b4d8c => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:02.249026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.365394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6285d-4f05-4d51-a0b8-83ad7be6d99d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.385507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:02.405227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.405903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.406217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.406531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.407351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=898c59e0eb63439d9ef5e544ec3b4d8c, user.id=86744ee89b4b45bc9032680969cc2aad) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:02.407703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.409285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed24d12-52ff-4366-a84f-04f466380dc3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.416441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 612/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:10:02 2022] GET /identity/v3/role_assignments?user.id=86744ee89b4b45bc9032680969cc2aad&scope.project.id=898c59e0eb63439d9ef5e544ec3b4d8c&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:12.229223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:12.413241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=9 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:05.562223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703e81-27a0-40ff-87fc-063202c6a619 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.563103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703e81-27a0-40ff-87fc-063202c6a619 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.563103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703e81-27a0-40ff-87fc-063202c6a619 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.564449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 589/1201] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:11:05.570456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599966-c895-4912-8739-aadabae095b4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.571331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599966-c895-4912-8739-aadabae095b4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.571331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599966-c895-4912-8739-aadabae095b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.595610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ea599966-c895-4912-8739-aadabae095b4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:05.597452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ea599966-c895-4912-8739-aadabae095b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:05.753902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 613/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:11:06.084690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703e81-27a0-40ff-87fc-063202c6a619 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.302165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703e81-27a0-40ff-87fc-063202c6a619 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.370304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.370963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.371267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.371578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.387319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.389099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:06.412359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:06.414368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:06.416275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:06.416275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:06.416275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:06.419427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 590/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:06.421227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599966-c895-4912-8739-aadabae095b4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.633048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599966-c895-4912-8739-aadabae095b4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.700882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:06.713165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.714444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.714933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.715395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.716657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:06.717217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.719403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f401e-7ed3-46f5-a49a-052b2b95fa63 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.744969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 614/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:06.749792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.860066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:06.972743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925efc0-eefe-46ad-bbe0-c9fac40fcdba None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.056365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc5c3c-2851-4ec0-a95e-051b8c3ed1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.057425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5c3c-2851-4ec0-a95e-051b8c3ed1a8 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.057879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5c3c-2851-4ec0-a95e-051b8c3ed1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.058570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5c3c-2851-4ec0-a95e-051b8c3ed1a8 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.059508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5c3c-2851-4ec0-a95e-051b8c3ed1a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.062396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5c3c-2851-4ec0-a95e-051b8c3ed1a8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.106287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 591/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Sep 1 05:11:06 2022] POST /identity/v3/users => generated 251 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:09.993130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd997da5-956b-4e19-ba24-f11796d45902 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:09.993930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd997da5-956b-4e19-ba24-f11796d45902 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:09.993930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd997da5-956b-4e19-ba24-f11796d45902 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:09.996711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 615/1206] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:11:10.003851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:10.004661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:10.004661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:10.027385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:10.028889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:10.144421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 592/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:10.437605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd997da5-956b-4e19-ba24-f11796d45902 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:10.615690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd997da5-956b-4e19-ba24-f11796d45902 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:10.669025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:10.670126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:10.670631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:10.670898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:10.686819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:11:10.693265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:10.694509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:10.695504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 616/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:10.701565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:10.773957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:10.891194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebac90-5dcd-42d2-93ff-d0ebf25f1bbe None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:10.954132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:10.954369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:10.954549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:10.955524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:10.956589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:10.957114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:10.959113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:10.973907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 593/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:10.982404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:11.075706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:11.160704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1cede-5195-4dae-8a1a-c5384df176ba None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:11.210419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:11.210683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:11.210934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:11.211184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:11.227466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:11.227727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:11.249480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:11.250901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:11.253016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:11.253016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:11.253016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:11.258085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 617/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:11.259906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:11.431547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:11.435155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cf0b7-662c-4d4b-89bd-68e70adf0794 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:11.487814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:11.488775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:11.489249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:11.489713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:11.490899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:11.491437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:11.493952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:11.515837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 594/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:11.525126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:11.702364 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ca92-f41d-4555-a71a-b16d796a10ef None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:11.705397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:11.758502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:11.759693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:11.760133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:11.760502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:11.771775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:11.773360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:11:11.787610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:11.788784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:11.789790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 618/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:11.799167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:12.011691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab78fcb-cce2-48f5-81d9-6ed5a69bebcf None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:12.085061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:12.085806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:12.086315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:12.086685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:12.087635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:12.088045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:12.090445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:12.118555 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 595/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 1 05:11:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:12.125119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:12.337614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8a021-c748-417b-8da9-84f8831e3605 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:12.405412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:12.406457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:12.406899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:12.407374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:12.467866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:12.547083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:12.550091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:12.733802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 619/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:11:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:11:12.743515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:12.781478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:12.939461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead464f-c069-4871-a450-a36f243886e4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.006050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106f98-4928-4855-a649-9caa09894578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.007313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106f98-4928-4855-a649-9caa09894578 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.007835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106f98-4928-4855-a649-9caa09894578 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.008523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106f98-4928-4855-a649-9caa09894578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.029937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43106f98-4928-4855-a649-9caa09894578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.036592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43106f98-4928-4855-a649-9caa09894578 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-43106f98-4928-4855-a649-9caa09894578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:13.065382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:13.067565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:13.069751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:13.069751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:13.069751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:13.071512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 596/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:13.083153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.180672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:13.249379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26007c2e-6797-4c21-b596-7ea7edd981de None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.304341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.305290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.305786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.306225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.307389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:13.307905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.310233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.340887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 620/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:13.344365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106f98-4928-4855-a649-9caa09894578 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.454203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:13.510755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106f98-4928-4855-a649-9caa09894578 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.568553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.569258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.570222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.570222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.579812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.582788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:11:13.608530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:13.610683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:13.612869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 597/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:13.620555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.762227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158ead-37a2-4313-a108-004a68c4f1b1 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.808152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:13.826395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.827345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.827759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.828083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.828925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:13.829270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.831762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd35d8-dd20-4550-9fc9-043412572313 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.849133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 621/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:13.857191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.991221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3132b0-4260-4f51-a46a-006371277073 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:14.025943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:14.033629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:14.036029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:14.036396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:14.036572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:14.037366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=5cfb84f7920d4d92b0fb290ac4ee105b) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:14.037669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:14.039243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653756a-475a-46bf-bea5-80df551cbc4e None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:14.046202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 598/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/role_assignments?user.id=5cfb84f7920d4d92b0fb290ac4ee105b&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:16.252395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d18f9-9420-4157-bc76-ba9d7fce3a74 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.253124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d18f9-9420-4157-bc76-ba9d7fce3a74 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.253523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d18f9-9420-4157-bc76-ba9d7fce3a74 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.256684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 622/1220] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:16.263737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.264702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.264702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.297566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:16.299863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:16.427029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 599/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:16.710040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d18f9-9420-4157-bc76-ba9d7fce3a74 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.851765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d18f9-9420-4157-bc76-ba9d7fce3a74 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.903590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.904253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.904525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.904821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.918073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:11:16.926848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:16.928736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:16.930421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 623/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:11:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:16.934364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.091700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86277595-3c2d-4b04-9c8b-27275043c5e1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.128995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:17.144995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.145864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.146297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.146677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.147681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:17.148117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.150316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.163486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 600/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:11:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:17.172893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.236729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:17.338962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248163-3a12-44e7-a5a7-2bef259d4ebc None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.404137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.404934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.405273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.405595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.418875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.420498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:17.439819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:17.442031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:17.444107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:17.444107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:17.444107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:17.444107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 624/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:17.448538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.593885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555a235-542e-4c38-8781-dbc307507ff3 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.668501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.669556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.670029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.670494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.671666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:17.672193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.674921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.696306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 601/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:17.702974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.834254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:17.845621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa425c23-abd9-4292-a427-09e0597b7df0 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.904071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.905018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.905420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.905868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.919868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.922951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:11:17.945017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:17.946860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:17.948133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 625/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:17.954396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.030532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:18.112040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5112e-60cd-4a80-975e-a94a096a7ef8 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.166765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.167773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.168201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.168716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.170190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:18.170666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.174294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:18.203023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 602/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 1 05:11:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:18.211577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.365990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ed71f-f55c-4338-b42c-76a343a5de80 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.441737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.442544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.442974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.443418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.462361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.464740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:18.485937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:18.488012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:18.490067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:18.490067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:18.490067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:18.490067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 626/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:18.495554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.631306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d829f0-27ba-4324-8240-5c2fdebef360 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.636007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:18.695525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.696187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.696462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.696778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.697452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:18.697848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.699394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:18.714676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 603/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:18.723377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.734698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:18.910988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c316-7478-441e-81e1-155e853c7af6 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.961278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.961953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.962227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.962495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.972061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.973633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:11:18.988077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:18.989252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:18.990173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:18.992907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 627/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:11:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:18.996219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:19.189592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c530c-ba1d-42ef-a456-7bdbe62c1887 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:19.235497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:19.236226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.237152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.237152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.238246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:19.238577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:19.240217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289eb02-e468-4514-850b-73fe4425514c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:19.258892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 604/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:11:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:19.266100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:19.371071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:19.435702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a0b1-c400-49c7-a32c-e56678e77174 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:19.483655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c781-bb5e-47c5-bbe3-fc6d6808c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:19.484342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c781-bb5e-47c5-bbe3-fc6d6808c1fc None admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.484757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c781-bb5e-47c5-bbe3-fc6d6808c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.485124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c781-bb5e-47c5-bbe3-fc6d6808c1fc None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/5cfb84f7920d4d92b0fb290ac4ee105b/roles/247c297fa7124218bb60e46ea36b2dba` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.507826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c781-bb5e-47c5-bbe3-fc6d6808c1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=5cfb84f7920d4d92b0fb290ac4ee105b, role_id=247c297fa7124218bb60e46ea36b2dba)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:19.510786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c781-bb5e-47c5-bbe3-fc6d6808c1fc None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:19.534027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 628/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:11:19 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/5cfb84f7920d4d92b0fb290ac4ee105b/roles/247c297fa7124218bb60e46ea36b2dba => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:21.663358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178808-a0ca-4869-8dd8-6253cc0d55e2 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:21.665009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178808-a0ca-4869-8dd8-6253cc0d55e2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:21.665009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178808-a0ca-4869-8dd8-6253cc0d55e2 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:21.666737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 605/1233] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:21.674331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:21.675014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:21.675014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:21.705436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:21.707680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:21.822011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 629/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:11:22.107949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178808-a0ca-4869-8dd8-6253cc0d55e2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:22.141160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:22.262390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18178808-a0ca-4869-8dd8-6253cc0d55e2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:22.314335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:22.315156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:22.315616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:22.316086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:22.332738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:11:22.339894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:22.341350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:22.342391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 606/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Sep 1 05:11:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:22.356972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:22.412278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:22.480857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af01900-4c53-4cd5-a08f-2aa67eff0358 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:22.531774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:22.532941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:22.533401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:22.533870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:22.535080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] RBAC: Adding query filter params (name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:22.535596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:22.538242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:22.552408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 630/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Sep 1 05:11:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:22.559619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:22.700064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:22.725291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4e63-5698-48cb-8d35-d7c12ae89ac0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:22.782525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:22.783286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:22.783691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:22.784106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:22.797809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:22.799825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:22.819627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:22.821960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:22.823804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:22.823804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:22.823804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:22.823804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 607/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:22.828021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:22.977428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cadb-ea1a-484b-8d25-a80348c67016 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:22.991348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:23.028672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:23.029272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:23.029712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:23.030073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:23.030855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:23.031270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:23.033832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:23.052774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 631/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:23.059107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:23.219694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58d950-791b-443d-a1cf-4d0f1e499236 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:23.278203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:23.279001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:23.279380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:23.279754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:23.284043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:23.292597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:23.294654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:11:23.309354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:23.311597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:23.313679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 608/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:23.317425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:23.470490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e925-52b8-45ad-922f-35371a4f77e7 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:23.529982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:23.530926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:23.531388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:23.531853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:23.533293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:23.533828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:23.536498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:23.572902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 632/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 1 05:11:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:23.581578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:23.766516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5db5-a7ae-48b0-b147-7b2cd05dc3c4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:23.811459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:23.812026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:23.812304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:23.812576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:23.913688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:23.924720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:23.926740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:24.073013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 609/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:11:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:11:24.080899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:24.118213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:24.225119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09f8a6-5ffe-4f9e-a0da-2d20a975f339 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:24.286352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:24.287251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:24.287650 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:24.288055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:24.305502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:24.307469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:24.331025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:24.332129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:24.334242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:24.334242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:24.334242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:24.334242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 633/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:24.339506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:24.482624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:24.491636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d110101-b866-4a2d-983b-e9ecdeafc3d6 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:24.546894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:24.547643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:24.548690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:24.548690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:24.549887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:24.550673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:24.553043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:24.571639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 610/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:24.578956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:24.716279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:24.743251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a30c5e-485a-45fd-9c84-daac8f117409 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:24.790523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:24.791763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:24.792267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:24.792779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:24.804283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:24.806322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:11:24.823363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:24.825512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:24.826999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 634/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:24.832578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:25.017156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785f6ed-6828-40e8-9537-b8997c4d46c7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:25.070234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:25.071053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:25.071545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:25.072087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:25.073451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:25.073891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:25.075773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93d07-45a6-4373-8068-70822ec24f30 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:25.093086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 611/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:25.101217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:25.248760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4b07-32b3-4f33-9cda-56701332a380 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:25.302828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:25.303569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:25.304026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:25.304378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:25.305369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] RBAC: Adding query filter params (role.id=247c297fa7124218bb60e46ea36b2dba, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=5cfb84f7920d4d92b0fb290ac4ee105b) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:25.305763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:25.307412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d300fa-4e71-473e-b081-8f5f5ab7f181 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:25.315483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 635/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:11:25 2022] GET /identity/v3/role_assignments?user.id=5cfb84f7920d4d92b0fb290ac4ee105b&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=247c297fa7124218bb60e46ea36b2dba => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:27.604770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d6b50-72c5-40b5-b3d3-703cc4e6c0dc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.605606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d6b50-72c5-40b5-b3d3-703cc4e6c0dc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.605606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d6b50-72c5-40b5-b3d3-703cc4e6c0dc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.607346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 612/1247] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:11:27.616259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.617000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.617381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.630236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:27.652250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:27.653648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:27.748770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 636/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:28.044464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d6b50-72c5-40b5-b3d3-703cc4e6c0dc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.066464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:28.200220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d6b50-72c5-40b5-b3d3-703cc4e6c0dc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.258252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.259251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.259768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.260294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.275462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:11:28.280774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:28.283098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:28.284741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 613/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:28.294878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.448660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d3c0-84e1-41e7-9ec5-7723f3d2ab1f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.491653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:28.502943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.502943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.502943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.502943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.503742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:28.503742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.503742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.514729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 637/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:28.526069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.664724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:28.702792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2ae6-5fd3-4c70-9a61-c96f69eccfc0 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.760327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.761314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.761713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.762012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.779776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.781772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:28.806319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:28.808318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:28.810168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:28.810168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:28.810168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:28.812915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 614/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:28.815781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.998978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c763fc-c30d-4059-9ccb-d9707a7efd15 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.073746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.074710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.075094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.075509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.076240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:29.076579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.079207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.097281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 638/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:29.104315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:29.267404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72c077-4c26-4949-9c3b-c764cbc720fe None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.321881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:29.334914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.335726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.336095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.336450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.348247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.350108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:11:29.370446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:29.372398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:29.374257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 615/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:29.383359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:29.473709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:29.557592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52d436-b06e-40e2-b803-34106457d522 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.625301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.626987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.627525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.628092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.629920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:29.630550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.633890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.671839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 639/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 1 05:11:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:29.680584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:29.855057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c7adc-63d5-4fec-bc60-617f467a2f6b None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.909170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.909170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.909170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.909170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.998942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:30.023727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:30.025368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:30.180807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 616/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:11:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:11:30.183455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:30.343496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483839-44a3-4e0b-bfeb-8c45f1ac283e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:30.366695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:30.400724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:30.401582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:30.402137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:30.402509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:30.417339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:30.419012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:30.447960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:30.449727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:30.458092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:30.458092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:30.458092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:30.458092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 640/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:11:30.458602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:30.602466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:30.623904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952625c-2464-4600-9ee4-45a7861e0b3d None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:30.684644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:30.685849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:30.686118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:30.686576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:30.687606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:30.688031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:30.691295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:30.708025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 617/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:30.718306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:30.907983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2291c2f-21da-4f39-ab5b-7a380a303f5d None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:30.971949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:30.972892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:30.973331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:30.973797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:30.985309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:30.987685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:11:31.004219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:31.005527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:31.006820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 641/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:31.015799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:31.171142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1c8ca-0968-450c-9381-44d70d323be9 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:31.241857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:31.242794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:31.243281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:31.243763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:31.245125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:31.245661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:31.248424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86554a-9585-42f2-a03c-f15b93201b42 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:31.271336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 618/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:31.278189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:31.317655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:31.443329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743c3b4-cafd-4adb-b141-87c75be96c12 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:31.495745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:31.496733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:31.497201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:31.497663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:31.498992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=5cfb84f7920d4d92b0fb290ac4ee105b) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:31.499519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:31.502660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3cd7a-0649-4a0a-889a-27b4b435fd94 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:31.513211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 642/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:11:31 2022] GET /identity/v3/role_assignments?user.id=5cfb84f7920d4d92b0fb290ac4ee105b&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=73d94b00a1864422b65efc55999d79b0 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:33.605878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7958b-b00c-4c22-8729-81d994346bcc None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:33.606679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7958b-b00c-4c22-8729-81d994346bcc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:33.606679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7958b-b00c-4c22-8729-81d994346bcc None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:33.607902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 619/1261] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:33.617620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:33.618355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:33.618355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:33.647673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:33.649525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:33.740906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 643/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:11:34.045227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7958b-b00c-4c22-8729-81d994346bcc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:34.067334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:34.233271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7958b-b00c-4c22-8729-81d994346bcc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:34.280402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:34.281127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.281405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.281677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.297407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:11:34.306199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:34.308142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:34.309503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 620/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:34.315869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:34.343721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:34.463772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16528b-3214-4cde-9da5-873f79d3d199 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:34.502201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:34.502827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.503097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.503352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.504018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:34.504306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:34.505737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:34.515225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 644/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:34.521649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:34.600517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:34.653140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911503b-6482-4fbb-a4c1-d40c673f6fd4 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:34.701761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:34.702419 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.702696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.702959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.715463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:34.716991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:34.734011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:34.735853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:34.738117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:34.738117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:34.738117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:34.738117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 621/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:34.742180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:34.837755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:34.862923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31a89-3166-4457-a0d1-e13ca2dcc5ad None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:34.902696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:34.903317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.903591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.903855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.904505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:34.904834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:34.906242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:34.920901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 645/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:34.927755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.053665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374463f3-0b03-4dae-83aa-dfb0cfe51922 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.079183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:35.098057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.098812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.099141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.099457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.108762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.111120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:11:35.124822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:35.126784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:35.129042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:35.132215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 622/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:35.133447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.255883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50592a08-f405-4d0f-ba0d-4a2573d4dc8e None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.295673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.296296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.296567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.296864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.297674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:35.298568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.299441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.310083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:35.320894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 646/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:35.327060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.444884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68394ee-5f58-4181-b278-8eef256ddd78 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.487217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.488316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.488864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.489339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.511111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.513896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:35.541681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:35.543011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:35.544171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:35.544171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:35.544171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:35.544171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 623/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:35.551669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.706978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f3cd0-8b8c-4114-b7a1-fc825f861073 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.749425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.750147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.750291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.751157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.752139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:35.752486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.753929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.768036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 647/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:35.774268 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.812585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:35.895496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53e3c-8f50-45d9-a0cc-d1b2c79e5478 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.936191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.936926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.937245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.937556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.945890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.947426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:11:35.960908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:35.962633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:35.964458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 624/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:35.970653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:36.062271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:36.132039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a2e0-8654-45a3-ac74-1c63fd7d5444 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:36.197732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:36.198746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:36.199200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:36.199620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:36.200824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:36.201347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:36.204490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e4ba0-8372-45c1-97c3-f7947f4978ac None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:36.227302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 648/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:36.233622 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:36.348756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:36.358892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42386ee-9cb5-407f-a2e4-3bcd7224a68c None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:36.399135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cbc68-5319-4893-94f2-bb6b5c8d4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:36.399819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cbc68-5319-4893-94f2-bb6b5c8d4f7f None admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:36.400099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cbc68-5319-4893-94f2-bb6b5c8d4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:36.400370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cbc68-5319-4893-94f2-bb6b5c8d4f7f None admin] PATH_INFO: `/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/5cfb84f7920d4d92b0fb290ac4ee105b/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:36.402520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cbc68-5319-4893-94f2-bb6b5c8d4f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=12ce0a3cfa094518917f5560f8695d0e, user_id=5cfb84f7920d4d92b0fb290ac4ee105b, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:36.404016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cbc68-5319-4893-94f2-bb6b5c8d4f7f None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:36.421061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 625/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Sep 1 05:11:36 2022] PUT /identity/v3/projects/12ce0a3cfa094518917f5560f8695d0e/users/5cfb84f7920d4d92b0fb290ac4ee105b/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:38.431156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dde0-254a-43f0-a082-1327385b522a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:38.431773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dde0-254a-43f0-a082-1327385b522a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:38.431773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dde0-254a-43f0-a082-1327385b522a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:38.433229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 649/1274] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:38.439867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:38.440443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:38.440443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:38.460710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:38.461950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:38.540234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 626/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:38.833366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649dde0-254a-43f0-a082-1327385b522a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:38.955065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649dde0-254a-43f0-a082-1327385b522a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:38.975549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:38.996304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:38.996987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:38.997259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:38.997528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:39.010850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:11:39.015881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:39.017703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:39.018762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 650/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Sep 1 05:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:39.024650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:39.171940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:39.194905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd6245-e6b5-4bab-b9a8-1ed9d9ccf823 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:39.233802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:39.234541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:39.234931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:39.235246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:39.235980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:39.236388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:39.237859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:39.247489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 627/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Sep 1 05:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:39.254089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:39.364255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65cb7-e0d5-4134-a738-bd22bd574ef4 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:39.403949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:39.404596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:39.404902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:39.405163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:39.417316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:39.418838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:39.435918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:39.438454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:39.439410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:39.439410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:39.439410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:39.439410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 651/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:39.443608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:39.568484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f7364-e91c-4f51-96e1-191285777258 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:39.633375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:39.634238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:39.634641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:39.634996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:39.635823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:39.636173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:39.637677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:39.652342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 628/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:39.662748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:39.719627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:39.836131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659493a1-839e-4152-a42c-82ec764987d5 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:39.878619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:39.879270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:39.879517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:39.879811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:39.889020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:39.890669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:11:39.903844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:39.905728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:39.907232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 652/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:39.914704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:39.919597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:40.077270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bed4e-2f98-4b85-918e-701b2037f354 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:40.134065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:40.134954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:40.135337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:40.135756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:40.136843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:40.137272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:40.139514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:40.171901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 629/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Sep 1 05:11:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:40.180668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:40.300708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:40.313114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587dcb8-7365-4878-9bfe-aa4ca73c663a None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:40.350896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:40.351516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:40.351783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:40.352043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:40.430473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:40.432046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:40.562657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:40.588549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 653/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Sep 1 05:11:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:11:40.598173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:40.683649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:40.732117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f400e16-0195-4018-a1f4-021277cc7aa7 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:40.785794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:40.786450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:40.786726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:40.786994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:40.804779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:40.806316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:11:40.826820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:40.828562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:11:40.829695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:11:40.829695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:11:40.829695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:40.830099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 630/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:40.838351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:40.975022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e937-2d93-4bf7-bcdd-b8db885e3c80 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:41.023008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:41.023988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:41.024435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:41.024920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:41.026001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:41.026470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:41.028493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:41.043959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 654/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Sep 1 05:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:41.052227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:41.200345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a683-7d77-4ed3-8871-12b1af8056ef None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:41.220712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:41.245389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:41.246040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:41.246318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:41.246584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:41.255238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:41.256889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:11:41.269913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:41.271809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: ERROR keystone.server.flask.application Sep 01 05:11:41.273864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 631/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Sep 1 05:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:41.279110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:41.343464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:41.447284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233b82-01b6-45a6-954d-3f115698c15f None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:41.519785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:41.520776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:41.521238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:41.521735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:41.522997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:41.523520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:41.526286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25654-3fd4-4f38-8f5f-7b0ed62a644e None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:41.559238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 655/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Sep 1 05:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:41.567289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:41.715247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87478b8-c7a9-4e11-ba5e-7eddf512ecc5 None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:41.760332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:41.760980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:41.761254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:41.761534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:41.762371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] RBAC: Adding query filter params (role.id=73d94b00a1864422b65efc55999d79b0, scope.project.id=12ce0a3cfa094518917f5560f8695d0e, user.id=5cfb84f7920d4d92b0fb290ac4ee105b) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:41.762719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:41.764324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1b25-3df9-4030-9ed1-bc17d3122454 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:41.772014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 632/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Sep 1 05:11:41 2022] GET /identity/v3/role_assignments?user.id=5cfb84f7920d4d92b0fb290ac4ee105b&scope.project.id=12ce0a3cfa094518917f5560f8695d0e&role.id=73d94b00a1864422b65efc55999d79b0 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:43.843514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015362a2-6fdc-4c76-8505-0504090ac39a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:43.844253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015362a2-6fdc-4c76-8505-0504090ac39a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:43.844253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015362a2-6fdc-4c76-8505-0504090ac39a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:43.845735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 656/1288] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:43.851874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:43.852478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:43.852478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:43.873277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:43.874721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:43.912502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:43.961472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 633/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:44.428835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015362a2-6fdc-4c76-8505-0504090ac39a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:44.558158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015362a2-6fdc-4c76-8505-0504090ac39a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:44.571850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:44.600103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:44.601253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:44.601563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:44.601834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:44.602542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:44.604240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:44.616610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:44.617968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:44.619659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 657/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:11:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:44.626888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:44.785206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea13e1-28bb-4777-ac26-4c6de46bfb03 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:44.826304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:44.826936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:44.827200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:44.827483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:44.828704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] RBAC: Adding query filter params (name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:44.829013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:44.830428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799009ba-a2bc-4d74-8520-5783554685ea None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:44.836278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 634/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 1 05:11:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:44.842752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:44.963782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a553c3-48d0-4470-9999-a01d540772d3 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:45.002073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:45.002702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:45.002974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:45.003234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] PATH_INFO: `/v3/services` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:45.003869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:45.004161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:45.005625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5506e5-6644-4769-8167-bede68139fb3 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:45.011142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 658/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 1 05:11:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:47.030906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455975-e20e-491b-a4a3-70400c5b371d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:47.031495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455975-e20e-491b-a4a3-70400c5b371d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:47.031495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455975-e20e-491b-a4a3-70400c5b371d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:47.032918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 635/1293] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:47.040541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d07016-06d3-43ae-9782-498d5bc924ac None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:47.041051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d07016-06d3-43ae-9782-498d5bc924ac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:47.041515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d07016-06d3-43ae-9782-498d5bc924ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:47.073321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-73d07016-06d3-43ae-9782-498d5bc924ac None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:47.075397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-73d07016-06d3-43ae-9782-498d5bc924ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:47.130318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:47.178298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 659/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:47.443915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455975-e20e-491b-a4a3-70400c5b371d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:47.499216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:47.590467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455975-e20e-491b-a4a3-70400c5b371d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:47.642986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63317c-d393-4ce3-b0f9-1f48b9c5b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:47.643873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63317c-d393-4ce3-b0f9-1f48b9c5b449 None admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:47.644288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63317c-d393-4ce3-b0f9-1f48b9c5b449 None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:47.644778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63317c-d393-4ce3-b0f9-1f48b9c5b449 None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:47.645779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63317c-d393-4ce3-b0f9-1f48b9c5b449 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:47.647799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63317c-d393-4ce3-b0f9-1f48b9c5b449 None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:47.676680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 636/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Sep 1 05:11:47 2022] POST /identity/v3/services => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:49.726708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637502-7cef-4e9b-91d5-9b0b1f6105f5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:49.727292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637502-7cef-4e9b-91d5-9b0b1f6105f5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:49.727292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26637502-7cef-4e9b-91d5-9b0b1f6105f5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:49.728898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 660/1296] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:49.734958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:49.735498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:49.735638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:49.757670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:49.758944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:49.853301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 637/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:11:50.132341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637502-7cef-4e9b-91d5-9b0b1f6105f5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:50.254822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26637502-7cef-4e9b-91d5-9b0b1f6105f5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:50.294281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:50.294856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:50.295097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:50.295383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:50.295990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:50.297660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:50.307750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:50.309964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:50.312673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 661/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:11:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:50.317395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:50.343956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:50.445170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1950019-93ec-498f-a583-62567eb6bddd None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:50.486541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:50.487176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:50.487425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:50.487714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:50.488369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] RBAC: Adding query filter params (name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:50.488700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:50.490136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:50.496192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 638/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 1 05:11:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:50.503438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:50.540014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:50.646737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8f56-2004-4f06-a4de-176e47bb06d8 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:50.700307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:50.701410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:50.701881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:50.702344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:50.703534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] RBAC: Adding query filter params (interface=public, service_id=05ad4860a39d44edad7fc82346f81084, region_id=RegionOne) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:50.703991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:50.706211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d7c8d-1f98-4fa6-bb4a-e2cf832ae143 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:50.715063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 662/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Sep 1 05:11:50 2022] GET /identity/v3/endpoints?service_id=05ad4860a39d44edad7fc82346f81084&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:50.721449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:50.818796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:50.840093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf181bd-66bb-4466-89c4-af6b41a005df None admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:50.880819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360298f-e76d-476a-9920-b83c7ffa5eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:50.881453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360298f-e76d-476a-9920-b83c7ffa5eee None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:50.881729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360298f-e76d-476a-9920-b83c7ffa5eee None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:50.881992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360298f-e76d-476a-9920-b83c7ffa5eee None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:50.882621 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360298f-e76d-476a-9920-b83c7ffa5eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:50.884035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360298f-e76d-476a-9920-b83c7ffa5eee None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:50.892920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 639/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Sep 1 05:11:50 2022] GET /identity/v3/services => generated 2191 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:11:52.979438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b993-853f-4820-9594-67747fcc9c11 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:52.980309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b993-853f-4820-9594-67747fcc9c11 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:52.980309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b993-853f-4820-9594-67747fcc9c11 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:52.981723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 663/1302] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:11:52.987956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:52.988748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:52.988748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.010107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:53.011331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:53.120812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 640/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:11:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:11:53.394906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4b993-853f-4820-9594-67747fcc9c11 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:53.515159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:53.523846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4b993-853f-4820-9594-67747fcc9c11 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:53.565626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:53.566332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.566651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.566982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.567629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:53.569196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:11:53.579377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:11:53.581357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application with Lock( Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: ERROR keystone.server.flask.application Sep 01 05:11:53.583106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 664/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Sep 1 05:11:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:11:53.586988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:53.686165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:53.728893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e61ad-afbc-41bd-acd6-1e174f46e988 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:53.790139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:53.791172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.791643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.792111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] PATH_INFO: `/v3/services` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.793289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:53.793790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:53.796661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9bfc-7cc8-4c73-9381-2f539b262b6a None admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:53.807147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 641/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Sep 1 05:11:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:53.814150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:53.965596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cfa09-6a11-4b3e-82eb-39fb477a3811 None admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.007125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8814d-3f38-442a-a952-618affe23185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.007896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8814d-3f38-442a-a952-618affe23185 None admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.008049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8814d-3f38-442a-a952-618affe23185 None admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.008307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8814d-3f38-442a-a952-618affe23185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.009037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8814d-3f38-442a-a952-618affe23185 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.010432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8814d-3f38-442a-a952-618affe23185 None admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.038681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 665/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:03.800693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=30 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:04.031102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:09.470209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2164ac-10cb-4a7e-b013-5d5b013dc1dd None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:09.471108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2164ac-10cb-4a7e-b013-5d5b013dc1dd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:09.471108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2164ac-10cb-4a7e-b013-5d5b013dc1dd None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:09.480095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 642/1307] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:09.482544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d66698-d695-4b9b-a76e-f4226e0762ea None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:09.483601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d66698-d695-4b9b-a76e-f4226e0762ea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:09.483601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d66698-d695-4b9b-a76e-f4226e0762ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:09.677086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b5d66698-d695-4b9b-a76e-f4226e0762ea None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:09.679204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b5d66698-d695-4b9b-a76e-f4226e0762ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:09.881298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 666/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:10.418292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e488-6639-4e6c-80df-ae043b770b5e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:10.418847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e488-6639-4e6c-80df-ae043b770b5e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:10.419247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e488-6639-4e6c-80df-ae043b770b5e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:10.421777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 643/1309] 10.222.0.57 () {54 vars in 965 bytes} [Thu Sep 1 05:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:10.447731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f81b3-fca1-4b4b-ad53-2606216bf357 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:10.449382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f81b3-fca1-4b4b-ad53-2606216bf357 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:10.451173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f81b3-fca1-4b4b-ad53-2606216bf357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:10.686405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9c7f81b3-fca1-4b4b-ad53-2606216bf357 None None] MFA Rules not processed for user `98a43f7e512946aab3f1d7ef7b8d4fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:10.688935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c7f81b3-fca1-4b4b-ad53-2606216bf357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:10.732974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:10.910629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 667/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Sep 1 05:13:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:10.924489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e488-6639-4e6c-80df-ae043b770b5e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:10.926440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9d48e488-6639-4e6c-80df-ae043b770b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:11.077775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e488-6639-4e6c-80df-ae043b770b5e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:11.166363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:11.167201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:11.168453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:11.168453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:11.169277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:11.249090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:11.353644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:11.355114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed505-b9d3-425f-8f9a-f85b426f6cd6 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:11.396837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 644/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:14.708412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbeffe-93e6-4469-a473-ea6660fc83a5 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:14.709310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbeffe-93e6-4469-a473-ea6660fc83a5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:14.709310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbeffe-93e6-4469-a473-ea6660fc83a5 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:14.710421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 668/1312] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:14.716473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e169c-56ea-4d07-9601-5b5fb2152239 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:14.717090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e169c-56ea-4d07-9601-5b5fb2152239 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:14.717090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e169c-56ea-4d07-9601-5b5fb2152239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:14.805879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4c3e169c-56ea-4d07-9601-5b5fb2152239 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:14.807142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4c3e169c-56ea-4d07-9601-5b5fb2152239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:14.942538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 645/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:15.231047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbeffe-93e6-4469-a473-ea6660fc83a5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:15.232917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b3fbeffe-93e6-4469-a473-ea6660fc83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:15.358803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbeffe-93e6-4469-a473-ea6660fc83a5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:15.472880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:15.476617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:15.477839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:15.478429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:15.479126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:15.481232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:15.620229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:15.621694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1821e5-e175-4b06-a06b-05c88d1db791 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:15.645003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 669/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:18.060704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d1895-2b3e-48c8-ad47-ccf543920007 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:18.061320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d1895-2b3e-48c8-ad47-ccf543920007 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:18.061695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d1895-2b3e-48c8-ad47-ccf543920007 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:18.064235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 646/1315] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:18.072922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e12b-1c88-4748-bf95-788420cf1e17 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:18.073742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e12b-1c88-4748-bf95-788420cf1e17 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:18.073899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e12b-1c88-4748-bf95-788420cf1e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:18.157263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0072e12b-1c88-4748-bf95-788420cf1e17 None None] MFA Rules not processed for user `a3ee5ad379424977ab3602ba23b1e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:18.159298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0072e12b-1c88-4748-bf95-788420cf1e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:18.250615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:18.307736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 670/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:18.626694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32f57-3777-42ef-b989-39885deeee8e None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:18.627007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32f57-3777-42ef-b989-39885deeee8e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:18.627469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c32f57-3777-42ef-b989-39885deeee8e None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:18.629850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 647/1317] 10.222.0.57 () {54 vars in 965 bytes} [Thu Sep 1 05:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:18.636483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123254-2433-45b8-8d0c-e7f9bbf0b549 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:18.636799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123254-2433-45b8-8d0c-e7f9bbf0b549 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:18.637063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123254-2433-45b8-8d0c-e7f9bbf0b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:18.740873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ad123254-2433-45b8-8d0c-e7f9bbf0b549 None None] MFA Rules not processed for user `98a43f7e512946aab3f1d7ef7b8d4fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:18.742335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ad123254-2433-45b8-8d0c-e7f9bbf0b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:18.836765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 671/1318] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Sep 1 05:13:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:18.847148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32f57-3777-42ef-b989-39885deeee8e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:18.848837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-11c32f57-3777-42ef-b989-39885deeee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:18.860544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:18.980944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c32f57-3777-42ef-b989-39885deeee8e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:19.074906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:19.075738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:19.075874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:19.076110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:19.077878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:19.151697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:19.207587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:19.209114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1808b-a34d-4032-860c-6506ffe5873f service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:19.232614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 648/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:22.371941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15153ca-e219-4eb4-b71f-dc00eef9df05 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:22.372799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15153ca-e219-4eb4-b71f-dc00eef9df05 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:22.373112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15153ca-e219-4eb4-b71f-dc00eef9df05 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:22.375706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 672/1320] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:22.382043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba32f2-14eb-4376-ab95-46659efc00f0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:22.382663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba32f2-14eb-4376-ab95-46659efc00f0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:22.382663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba32f2-14eb-4376-ab95-46659efc00f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:22.460411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-78ba32f2-14eb-4376-ab95-46659efc00f0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:22.461907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-78ba32f2-14eb-4376-ab95-46659efc00f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:22.586474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 649/1321] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:22.878512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15153ca-e219-4eb4-b71f-dc00eef9df05 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:22.880297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a15153ca-e219-4eb4-b71f-dc00eef9df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:22.945498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:23.009817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15153ca-e219-4eb4-b71f-dc00eef9df05 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:23.114243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:23.115276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:23.115755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:23.116231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:23.119295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:23.239277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:23.256606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:23.258188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35209e8d-8c8f-4260-8ca0-848fd3aad7b0 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:23.279301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 673/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:26.272396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4f423-d447-4fcb-8f9a-af4a05de21c2 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:26.273132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4f423-d447-4fcb-8f9a-af4a05de21c2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:26.273281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4f423-d447-4fcb-8f9a-af4a05de21c2 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:26.275864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 650/1323] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:26.285221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb195-9bf2-49ea-a328-d18840487b05 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:26.286101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb195-9bf2-49ea-a328-d18840487b05 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:26.286101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb195-9bf2-49ea-a328-d18840487b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:26.376466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-24dbb195-9bf2-49ea-a328-d18840487b05 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:26.377920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-24dbb195-9bf2-49ea-a328-d18840487b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:26.502350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 674/1324] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:26.793486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4f423-d447-4fcb-8f9a-af4a05de21c2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:26.795393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5b4f423-d447-4fcb-8f9a-af4a05de21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:26.823095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:26.951489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4f423-d447-4fcb-8f9a-af4a05de21c2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:27.050666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:27.051296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:27.051575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:27.051848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:27.053609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:27.145392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:27.195322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:27.197094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4aea3-5cfc-43dc-b97c-3886ee23455c service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:27.220520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 651/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:29.873117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b090-2eee-4f18-88e6-34f235d46f4f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:29.873745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b090-2eee-4f18-88e6-34f235d46f4f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:29.873745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b090-2eee-4f18-88e6-34f235d46f4f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:29.876599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 675/1326] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:29.885121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f44b-b16c-4733-a9a6-583387e5effa None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:29.886033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f44b-b16c-4733-a9a6-583387e5effa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:29.886192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f44b-b16c-4733-a9a6-583387e5effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:29.966415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8c18f44b-b16c-4733-a9a6-583387e5effa None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:29.967699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8c18f44b-b16c-4733-a9a6-583387e5effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:30.104032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 652/1327] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:30.414956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b090-2eee-4f18-88e6-34f235d46f4f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:30.416587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7a20b090-2eee-4f18-88e6-34f235d46f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:30.515383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:30.573979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b090-2eee-4f18-88e6-34f235d46f4f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:30.696674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:30.697566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:30.698046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:30.698462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:30.702488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:30.883748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:30.887456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:30.889580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77e66-13a2-4000-8dee-06f824d4396e service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:30.913124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 676/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:13:33.033506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5e2c-42da-4aa1-b163-d317f91afe84 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:33.034323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5e2c-42da-4aa1-b163-d317f91afe84 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:33.034492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5e2c-42da-4aa1-b163-d317f91afe84 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:33.036285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 653/1329] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:33.043451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eda9d-42ed-49f6-ac3e-3e1898eb7c14 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:33.044227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eda9d-42ed-49f6-ac3e-3e1898eb7c14 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:33.044227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eda9d-42ed-49f6-ac3e-3e1898eb7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:33.148806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4b4eda9d-42ed-49f6-ac3e-3e1898eb7c14 None None] MFA Rules not processed for user `a3ee5ad379424977ab3602ba23b1e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:33.151173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4b4eda9d-42ed-49f6-ac3e-3e1898eb7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:33.307129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 677/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:33.634000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a5e2c-42da-4aa1-b163-d317f91afe84 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:33.635695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cd0a5e2c-42da-4aa1-b163-d317f91afe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:33.680978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:33.814210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a5e2c-42da-4aa1-b163-d317f91afe84 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:33.944061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:33.946727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:33.947287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:33.947753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:33.951188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:34.088830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:34.158895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:34.161432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670361-ec40-4d8d-bb89-7b46f08a69e2 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:34.197537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 654/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:36.819360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371872dc-f883-432d-b47c-de0ec616e680 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:36.819939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371872dc-f883-432d-b47c-de0ec616e680 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:36.819939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371872dc-f883-432d-b47c-de0ec616e680 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:36.821447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 678/1332] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:36.828146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bca9-0960-46e7-a20d-ee16dc4bbb00 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:36.828933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bca9-0960-46e7-a20d-ee16dc4bbb00 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:36.828933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bca9-0960-46e7-a20d-ee16dc4bbb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:36.909811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1ab0bca9-0960-46e7-a20d-ee16dc4bbb00 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:36.911081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1ab0bca9-0960-46e7-a20d-ee16dc4bbb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:37.067825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 655/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:37.347140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371872dc-f883-432d-b47c-de0ec616e680 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:37.348924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-371872dc-f883-432d-b47c-de0ec616e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:37.432525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:37.472076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371872dc-f883-432d-b47c-de0ec616e680 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:37.554429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:37.555051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:37.555323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:37.555587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:37.557279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:37.700711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:37.702255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483232ea-7873-45b9-81f6-589a0b3195aa service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:37.714508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:37.725154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 679/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:39.823149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7075d-6a3d-4f16-a844-bb4f701e60e9 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:39.823763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7075d-6a3d-4f16-a844-bb4f701e60e9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:39.823763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7075d-6a3d-4f16-a844-bb4f701e60e9 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:39.825252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 656/1335] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:39.831916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c1d4-7913-4b48-82aa-0de125db55e8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:39.832516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c1d4-7913-4b48-82aa-0de125db55e8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:39.832516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c1d4-7913-4b48-82aa-0de125db55e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:39.915913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1500c1d4-7913-4b48-82aa-0de125db55e8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:39.917219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1500c1d4-7913-4b48-82aa-0de125db55e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:40.084567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 680/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:13:40.375704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7075d-6a3d-4f16-a844-bb4f701e60e9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:40.377644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-25f7075d-6a3d-4f16-a844-bb4f701e60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:40.426042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:40.505118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7075d-6a3d-4f16-a844-bb4f701e60e9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:40.596359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:40.597019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:40.597295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:40.597563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:40.599231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:40.744754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:40.781843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:40.783417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6feabd-d1b1-46fa-8732-842833189f99 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:40.807448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 657/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:13:43.743650 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161590-9855-4add-a8a3-b0e7d46eb34d None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:43.744445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161590-9855-4add-a8a3-b0e7d46eb34d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:43.744445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161590-9855-4add-a8a3-b0e7d46eb34d None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:43.745696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 681/1338] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:43.753797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d31d8-968c-4517-8a7e-9df1ec8202cb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:43.754386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d31d8-968c-4517-8a7e-9df1ec8202cb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:43.754729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d31d8-968c-4517-8a7e-9df1ec8202cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:43.880313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-248d31d8-968c-4517-8a7e-9df1ec8202cb None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:43.882399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-248d31d8-968c-4517-8a7e-9df1ec8202cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:44.013777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 658/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:44.301456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161590-9855-4add-a8a3-b0e7d46eb34d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:44.303076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bb161590-9855-4add-a8a3-b0e7d46eb34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:44.398003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:44.432446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161590-9855-4add-a8a3-b0e7d46eb34d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:44.522679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:44.523305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:44.523584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:44.523870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:44.525601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:44.668668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:44.671598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30335f33-738c-4caa-a6df-82127e37c208 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:44.709410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 682/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:50.083892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0e73b-2592-4f4e-9f54-c9006bb47c0d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:50.084498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0e73b-2592-4f4e-9f54-c9006bb47c0d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:50.084498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0e73b-2592-4f4e-9f54-c9006bb47c0d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:50.085915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 659/1341] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:13:50.092150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454d6b-5bb6-4100-bcfc-8a5b7a1d5f23 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:50.092894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454d6b-5bb6-4100-bcfc-8a5b7a1d5f23 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:50.093081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454d6b-5bb6-4100-bcfc-8a5b7a1d5f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:50.099072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:50.178425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-db454d6b-5bb6-4100-bcfc-8a5b7a1d5f23 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:50.179828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-db454d6b-5bb6-4100-bcfc-8a5b7a1d5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:50.321825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 683/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:50.613903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0e73b-2592-4f4e-9f54-c9006bb47c0d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:50.616062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5bd0e73b-2592-4f4e-9f54-c9006bb47c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:50.684947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:50.759479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0e73b-2592-4f4e-9f54-c9006bb47c0d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:50.862789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:50.863463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:50.863834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:50.864247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:50.866322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:51.017981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:51.041260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:51.043245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33e8d3-a2b2-4fe6-b777-b9c37463ebd7 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:51.068419 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 660/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:54.104465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abee1f-2687-4e52-afec-62104d54baa6 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:54.105408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abee1f-2687-4e52-afec-62104d54baa6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:54.105408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abee1f-2687-4e52-afec-62104d54baa6 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:54.106527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 684/1344] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:13:54.113396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0c981-3397-40fd-bc77-9377e96acc05 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:54.114301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0c981-3397-40fd-bc77-9377e96acc05 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:54.114301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0c981-3397-40fd-bc77-9377e96acc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:54.198509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-79a0c981-3397-40fd-bc77-9377e96acc05 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:54.200194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-79a0c981-3397-40fd-bc77-9377e96acc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:54.336495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 661/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:54.631136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abee1f-2687-4e52-afec-62104d54baa6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:54.633159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b6abee1f-2687-4e52-afec-62104d54baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:54.803311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:54.826681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abee1f-2687-4e52-afec-62104d54baa6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:54.965746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:54.967174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:54.967636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:54.968111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:54.971932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:55.109471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:55.110958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c8073-a9e6-40a8-9e38-f0c0cea8ddca service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:55.132360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 685/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:59.816464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016eadd-c077-41f4-aa04-05df3277e417 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:59.817439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016eadd-c077-41f4-aa04-05df3277e417 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:59.817439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016eadd-c077-41f4-aa04-05df3277e417 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:59.818743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 662/1347] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:13:59.824695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9cfc-c477-47f5-a1fb-84f8a4847227 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:59.825393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9cfc-c477-47f5-a1fb-84f8a4847227 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:59.825393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9cfc-c477-47f5-a1fb-84f8a4847227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:59.843419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:59.944609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-185f9cfc-c477-47f5-a1fb-84f8a4847227 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:59.946752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-185f9cfc-c477-47f5-a1fb-84f8a4847227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:00.116495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 686/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:00.472471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016eadd-c077-41f4-aa04-05df3277e417 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:00.475513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1016eadd-c077-41f4-aa04-05df3277e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:00.593563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:00.669088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016eadd-c077-41f4-aa04-05df3277e417 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:00.817435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:00.818508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:00.819027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:00.819502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:00.822951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:01.008751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:01.013918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:01.015202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a75cb6-a14f-45fe-a1d1-27cd284ccfb9 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:01.039786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 663/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:07.554084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ceb92-4a67-43d1-a0c5-447683021b96 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:07.554928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ceb92-4a67-43d1-a0c5-447683021b96 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:07.555474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ceb92-4a67-43d1-a0c5-447683021b96 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:07.557633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 687/1350] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:07.563830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f5a56-d226-4746-91dc-e208e50356b6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:07.568295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f5a56-d226-4746-91dc-e208e50356b6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:07.568882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f5a56-d226-4746-91dc-e208e50356b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:07.779689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6b7f5a56-d226-4746-91dc-e208e50356b6 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:07.785119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6b7f5a56-d226-4746-91dc-e208e50356b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:07.999595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 664/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:14:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:10.112518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=59 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:12.500344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e83e7-1e84-4f0c-afd9-c8dd9fb3938e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:12.502427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e83e7-1e84-4f0c-afd9-c8dd9fb3938e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:12.503022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e83e7-1e84-4f0c-afd9-c8dd9fb3938e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:12.505571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 688/1352] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:14:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:12.513974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab46e-fc14-4900-b232-b835df3c7865 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:12.514795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab46e-fc14-4900-b232-b835df3c7865 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:12.515183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab46e-fc14-4900-b232-b835df3c7865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:12.588249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:12.617603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-299ab46e-fc14-4900-b232-b835df3c7865 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:12.618949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-299ab46e-fc14-4900-b232-b835df3c7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:12.766394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 665/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:14:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:14.589867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c677e7-c425-489c-adeb-c37e48db646e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:14.590712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c677e7-c425-489c-adeb-c37e48db646e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:14.590712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c677e7-c425-489c-adeb-c37e48db646e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:14.592175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 689/1354] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:14.598083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f398-3779-4342-8b42-0d946ce3b263 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:14.598824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f398-3779-4342-8b42-0d946ce3b263 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:14.598824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5f398-3779-4342-8b42-0d946ce3b263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:14.693680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d3e5f398-3779-4342-8b42-0d946ce3b263 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:14.695261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d3e5f398-3779-4342-8b42-0d946ce3b263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:14.751023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:14.848275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 666/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:14:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:18.352001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7cb7f-034e-4ede-a17d-c01e399dfca0 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:18.353093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7cb7f-034e-4ede-a17d-c01e399dfca0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:18.353093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7cb7f-034e-4ede-a17d-c01e399dfca0 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:18.356086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 690/1356] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:18.363816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452d15c-acfb-4bba-b781-27ca6560f5f3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:18.364430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452d15c-acfb-4bba-b781-27ca6560f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:18.364764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452d15c-acfb-4bba-b781-27ca6560f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:18.493226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0452d15c-acfb-4bba-b781-27ca6560f5f3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:18.494782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0452d15c-acfb-4bba-b781-27ca6560f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:18.648370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 667/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:18.960705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdaa1-ab77-46c9-aece-ec22e07ef3a2 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:18.961001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdaa1-ab77-46c9-aece-ec22e07ef3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:18.961232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdaa1-ab77-46c9-aece-ec22e07ef3a2 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:18.963190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 691/1358] 10.222.0.57 () {54 vars in 962 bytes} [Thu Sep 1 05:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:18.973022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480727d-5c7a-4eba-a380-d7d9219e9a7b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:18.973668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480727d-5c7a-4eba-a380-d7d9219e9a7b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:18.974145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480727d-5c7a-4eba-a380-d7d9219e9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:18.997242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:19.077931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1480727d-5c7a-4eba-a380-d7d9219e9a7b None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:19.079143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1480727d-5c7a-4eba-a380-d7d9219e9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:19.238890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 668/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Sep 1 05:14:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:19.248379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cdaa1-ab77-46c9-aece-ec22e07ef3a2 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:19.251335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ab0cdaa1-ab77-46c9-aece-ec22e07ef3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:19.487442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cdaa1-ab77-46c9-aece-ec22e07ef3a2 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:19.594709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:19.682336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:19.683286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:19.683908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:19.684339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:19.687452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:19.813069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:19.816144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb852e1-e29b-404b-9afa-3c820c95e232 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:19.840958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 692/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:22.559693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01726-30cd-46cf-a940-f4683e302d5c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:22.560350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01726-30cd-46cf-a940-f4683e302d5c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:22.560350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01726-30cd-46cf-a940-f4683e302d5c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:22.562561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 669/1361] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:22.568395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ee908-759f-4ac4-b52a-2d7566261ac4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:22.569083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ee908-759f-4ac4-b52a-2d7566261ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:22.569083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ee908-759f-4ac4-b52a-2d7566261ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:22.671988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5d1ee908-759f-4ac4-b52a-2d7566261ac4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:22.673523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5d1ee908-759f-4ac4-b52a-2d7566261ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:22.728182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:22.832835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 693/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:23.142355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d01726-30cd-46cf-a940-f4683e302d5c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:23.144960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a8d01726-30cd-46cf-a940-f4683e302d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:23.255971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:23.416389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d01726-30cd-46cf-a940-f4683e302d5c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:23.594165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:23.595214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:23.595719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:23.596206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:23.599222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:23.629983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:23.742623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:23.745101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f81004-4bbc-49f1-a7e1-8b2b38c24b8e service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:23.773392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 670/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:26.202455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b53e6-865e-4852-9215-d674e5432c8a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:26.203374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b53e6-865e-4852-9215-d674e5432c8a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:26.203374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b53e6-865e-4852-9215-d674e5432c8a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:26.204926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 694/1364] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:26.214515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa269cb-7abd-49e9-bba0-cc4d4a3e1c2d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:26.215097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa269cb-7abd-49e9-bba0-cc4d4a3e1c2d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:26.215390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa269cb-7abd-49e9-bba0-cc4d4a3e1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:26.361377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-caa269cb-7abd-49e9-bba0-cc4d4a3e1c2d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:26.364443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-caa269cb-7abd-49e9-bba0-cc4d4a3e1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:26.591688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:26.604712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 671/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:26.930005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42515f2f-e5eb-4bb5-af95-7936813a3c38 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:26.930286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42515f2f-e5eb-4bb5-af95-7936813a3c38 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:26.930619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42515f2f-e5eb-4bb5-af95-7936813a3c38 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:26.932176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 695/1366] 10.222.0.57 () {54 vars in 962 bytes} [Thu Sep 1 05:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:14:26.938401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9d11-8084-455f-91f0-04e3d4f7e414 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:26.938699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9d11-8084-455f-91f0-04e3d4f7e414 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:26.939012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9d11-8084-455f-91f0-04e3d4f7e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:27.063476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-57cf9d11-8084-455f-91f0-04e3d4f7e414 None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:27.065377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-57cf9d11-8084-455f-91f0-04e3d4f7e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:27.220673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 672/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Sep 1 05:14:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:27.229891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42515f2f-e5eb-4bb5-af95-7936813a3c38 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:27.233283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-42515f2f-e5eb-4bb5-af95-7936813a3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:27.472266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42515f2f-e5eb-4bb5-af95-7936813a3c38 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:27.505513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:27.706749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:27.707911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:27.708489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:27.708984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:27.712374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:27.920683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:27.923215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374cb19-3b24-4312-aaff-9a630571f7e7 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:27.961159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 696/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:28.557782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e876-743e-40c4-81d6-0b77c0e419c8 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:28.558674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e876-743e-40c4-81d6-0b77c0e419c8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:28.558674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e876-743e-40c4-81d6-0b77c0e419c8 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:28.560841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 673/1369] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:28.567059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c9aa2-c319-4561-8927-154b5efa6214 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:28.567905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c9aa2-c319-4561-8927-154b5efa6214 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:28.568048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c9aa2-c319-4561-8927-154b5efa6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:28.615964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:28.666104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-443c9aa2-c319-4561-8927-154b5efa6214 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:28.667512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-443c9aa2-c319-4561-8927-154b5efa6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:28.832759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 697/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:29.438909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bb69b-6e27-47ef-93d9-8ac055119a80 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:29.438909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bb69b-6e27-47ef-93d9-8ac055119a80 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:29.438909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bb69b-6e27-47ef-93d9-8ac055119a80 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:29.440477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 674/1371] 10.222.0.57 () {54 vars in 964 bytes} [Thu Sep 1 05:14:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:29.448654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee37a-4e04-4144-9a5d-06d5ea0f3eff None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:29.448654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee37a-4e04-4144-9a5d-06d5ea0f3eff None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:29.448654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee37a-4e04-4144-9a5d-06d5ea0f3eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:29.592053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7a0ee37a-4e04-4144-9a5d-06d5ea0f3eff None None] MFA Rules not processed for user `9266a63ee919403f880344cfe2efb5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:29.594077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7a0ee37a-4e04-4144-9a5d-06d5ea0f3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:29.666878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:29.708230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 698/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Sep 1 05:14:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:29.716240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bb69b-6e27-47ef-93d9-8ac055119a80 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:29.718012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-132bb69b-6e27-47ef-93d9-8ac055119a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:29.779279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:29.860122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bb69b-6e27-47ef-93d9-8ac055119a80 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:29.966507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:29.967190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:29.967467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:29.967989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:29.971664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:30.105003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:30.125247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:30.126634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350ed70-d700-4457-9269-e0a23a062ea9 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:30.164391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 675/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:14:30.764978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5028-3a1a-4c6f-8824-1d984c499278 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:30.765731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5028-3a1a-4c6f-8824-1d984c499278 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:30.765731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5028-3a1a-4c6f-8824-1d984c499278 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:30.766913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 699/1374] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:14:30.774154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31b9f9-c2bd-46f2-97ad-cb593059e931 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:30.774726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31b9f9-c2bd-46f2-97ad-cb593059e931 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:30.774858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31b9f9-c2bd-46f2-97ad-cb593059e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:30.864404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9a31b9f9-c2bd-46f2-97ad-cb593059e931 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:30.865937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9a31b9f9-c2bd-46f2-97ad-cb593059e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:31.012031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 676/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:31.324157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5028-3a1a-4c6f-8824-1d984c499278 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:31.325981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3d9d5028-3a1a-4c6f-8824-1d984c499278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:31.514379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5028-3a1a-4c6f-8824-1d984c499278 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:31.591226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:31.670355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:31.670355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:31.671340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:31.671489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:31.673258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:31.777584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:31.779273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef07f0a-bc40-4642-8459-0c6e88d51859 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:31.800536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 700/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:33.868569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4a21-57f1-43de-9b62-734184f423ab None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:33.869416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4a21-57f1-43de-9b62-734184f423ab None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:33.869416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4a21-57f1-43de-9b62-734184f423ab None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:33.870574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 677/1377] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:14:33.876815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7491-0bdf-4e6a-9413-00515a774b56 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:33.877969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7491-0bdf-4e6a-9413-00515a774b56 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:33.877969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7491-0bdf-4e6a-9413-00515a774b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:33.965598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-997b7491-0bdf-4e6a-9413-00515a774b56 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:33.967977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-997b7491-0bdf-4e6a-9413-00515a774b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:33.977928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:34.119682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 701/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:34.454765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4a21-57f1-43de-9b62-734184f423ab None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:34.456705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7f5e4a21-57f1-43de-9b62-734184f423ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:34.545650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:34.672028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4a21-57f1-43de-9b62-734184f423ab None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:34.809226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:34.809765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:34.810084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:34.810315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:34.812026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:34.834467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:34.924439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:34.926112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbb885-37dc-4b7a-9a4c-74ad5bd772c4 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:34.949645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 678/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:37.266643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b5970-dc96-419e-ba77-6d74a404fd36 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:37.267253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b5970-dc96-419e-ba77-6d74a404fd36 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:37.267253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b5970-dc96-419e-ba77-6d74a404fd36 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:37.268726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 702/1380] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:37.274531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4ed41-c00a-4742-a26f-63f8d67efc35 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:37.275141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4ed41-c00a-4742-a26f-63f8d67efc35 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:37.275141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4ed41-c00a-4742-a26f-63f8d67efc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:37.366197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-19c4ed41-c00a-4742-a26f-63f8d67efc35 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:37.368116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-19c4ed41-c00a-4742-a26f-63f8d67efc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:37.496806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:37.508074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 679/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:37.804104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b5970-dc96-419e-ba77-6d74a404fd36 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:37.805731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-670b5970-dc96-419e-ba77-6d74a404fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:38.041362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:38.056237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b5970-dc96-419e-ba77-6d74a404fd36 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:38.276080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:38.277285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:38.277681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:38.278146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:38.281446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:38.426262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:38.429105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c2661-c432-4c55-b2f6-a6abbce3498a service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:38.445229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:38.461690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 703/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:14:40.626306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d00e2-1104-474a-8d97-7297795b85b3 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:40.626941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d00e2-1104-474a-8d97-7297795b85b3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:40.627286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d00e2-1104-474a-8d97-7297795b85b3 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:40.630592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 680/1383] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:14:40.637193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbaafa-ca71-4841-beb3-2ded90d666fc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:40.638294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbaafa-ca71-4841-beb3-2ded90d666fc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:40.638642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbaafa-ca71-4841-beb3-2ded90d666fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:40.737761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-dccbaafa-ca71-4841-beb3-2ded90d666fc None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:40.739084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dccbaafa-ca71-4841-beb3-2ded90d666fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:40.926609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 704/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:41.228009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d00e2-1104-474a-8d97-7297795b85b3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:41.229944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eb0d00e2-1104-474a-8d97-7297795b85b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:41.441249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d00e2-1104-474a-8d97-7297795b85b3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:41.549649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:41.606833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:41.607812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:41.607987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:41.608129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:41.610104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:41.740770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:41.742429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f274b-0a51-445f-b386-48acd2552f87 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:41.762828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 681/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:44.079332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee480cb-03ad-49fe-8fb6-4850d021ab60 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:44.080227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee480cb-03ad-49fe-8fb6-4850d021ab60 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:44.080227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee480cb-03ad-49fe-8fb6-4850d021ab60 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:44.082027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 705/1386] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:44.088957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a083abe-b843-4c59-877c-ee5e53c574ea None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:44.089553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a083abe-b843-4c59-877c-ee5e53c574ea None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:44.089815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a083abe-b843-4c59-877c-ee5e53c574ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:44.185638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0a083abe-b843-4c59-877c-ee5e53c574ea None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:44.187682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0a083abe-b843-4c59-877c-ee5e53c574ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:44.264755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:44.369292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 682/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:44.736689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee480cb-03ad-49fe-8fb6-4850d021ab60 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:44.739486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cee480cb-03ad-49fe-8fb6-4850d021ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:44.862556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:44.996068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee480cb-03ad-49fe-8fb6-4850d021ab60 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:45.184288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:45.185636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:45.185636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:45.185636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:45.187487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:45.243862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:45.318449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:45.320084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee366d-119b-4bd2-9bfc-c5bf90397522 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:45.344177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 706/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:46.908845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74bdf7-b297-46e2-8065-27f86727e8c5 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:46.909658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74bdf7-b297-46e2-8065-27f86727e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:46.909840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74bdf7-b297-46e2-8065-27f86727e8c5 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:46.912362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 683/1389] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:46.923250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0f3c-97b8-4f22-818f-1dc8c7504e51 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:46.923250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0f3c-97b8-4f22-818f-1dc8c7504e51 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:46.923250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0f3c-97b8-4f22-818f-1dc8c7504e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:47.037867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-730c0f3c-97b8-4f22-818f-1dc8c7504e51 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:47.039921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-730c0f3c-97b8-4f22-818f-1dc8c7504e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:47.187684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 707/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:47.515962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d10c-d971-44b1-be32-bbf672009fd4 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:47.516455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d10c-d971-44b1-be32-bbf672009fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:47.516926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d10c-d971-44b1-be32-bbf672009fd4 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:47.518607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 684/1391] 10.222.0.57 () {54 vars in 967 bytes} [Thu Sep 1 05:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:47.524913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:47.525276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:47.525603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:47.551699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:47.622698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ad4d-56cb-4558-8614-9dc55ef1679f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:47.623128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ad4d-56cb-4558-8614-9dc55ef1679f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:47.623539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ad4d-56cb-4558-8614-9dc55ef1679f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:47.625068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 685/1392] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:14:47.629046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] MFA Rules not processed for user `a847910274f346d5b0320b725599b14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:47.630289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:47.631133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:47.631420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:47.631697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:47.713425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:47.715370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:47.755056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 708/1393] 10.222.0.57 () {58 vars in 1064 bytes} [Thu Sep 1 05:14:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:47.764649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:47.778565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf273e0-c4cc-4904-aaaf-fe9a1b2d9824 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:47.850791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 686/1394] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:14:47.896731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:47.897594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:47.897971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:47.898343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:47.900489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:47.947697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:48.095418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:48.097196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10ae21-afbe-4b22-9e49-f0a6ff2d47f2 service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:48.120490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 709/1395] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:48.208161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:48.209735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:48.226370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:48.352516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c59be1-b39e-44c4-951d-cf4db0bdb1de None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:48.527641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:48.528488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:48.528808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:48.529141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:48.531648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:48.548464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:48.697739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:48.700943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906d5c0-bfad-4f6c-9d63-79c662d49a42 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:48.727900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 687/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:49.065271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdf5e-a654-409d-93fa-04527c5600c4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:49.065947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdf5e-a654-409d-93fa-04527c5600c4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:49.065947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdf5e-a654-409d-93fa-04527c5600c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:49.160824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a41bdf5e-a654-409d-93fa-04527c5600c4 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:49.162483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a41bdf5e-a654-409d-93fa-04527c5600c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:49.273477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:49.284138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 710/1397] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:14:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:49.340239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e5b22-fd24-4123-9773-115202574c19 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:49.341161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e5b22-fd24-4123-9773-115202574c19 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:49.341161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e5b22-fd24-4123-9773-115202574c19 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:49.342598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 688/1398] 10.222.0.57 () {54 vars in 943 bytes} [Thu Sep 1 05:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:49.350835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad54c6-b30f-4529-9123-42d8ef168b0f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:49.351118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad54c6-b30f-4529-9123-42d8ef168b0f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:49.351395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad54c6-b30f-4529-9123-42d8ef168b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:49.455579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9bad54c6-b30f-4529-9123-42d8ef168b0f None None] MFA Rules not processed for user `594ce9d8a0164a559fa14327d308c7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:49.457489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9bad54c6-b30f-4529-9123-42d8ef168b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:49.645969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 711/1399] 10.222.0.57 () {58 vars in 1040 bytes} [Thu Sep 1 05:14:49 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:49.657873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e5b22-fd24-4123-9773-115202574c19 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:49.659428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-435e5b22-fd24-4123-9773-115202574c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:49.900731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:49.904571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e5b22-fd24-4123-9773-115202574c19 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:50.087114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:50.087868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:50.088272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:50.088610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:50.090585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:50.200469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:50.203580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e1a8-f0fd-498b-bbb6-efa4911ad099 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:50.221262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 689/1400] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:14:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:50.868598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f46ea-d313-4279-892d-ca77ebda97c4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:50.869354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f46ea-d313-4279-892d-ca77ebda97c4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:50.869354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f46ea-d313-4279-892d-ca77ebda97c4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:50.873154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 712/1401] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:50.876354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae83ea-6665-46c7-9744-7ccc10960ac7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:50.877152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae83ea-6665-46c7-9744-7ccc10960ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:50.877152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae83ea-6665-46c7-9744-7ccc10960ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:50.939514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:50.979769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-22ae83ea-6665-46c7-9744-7ccc10960ac7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:50.983799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-22ae83ea-6665-46c7-9744-7ccc10960ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:51.116811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 690/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:51.418838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f46ea-d313-4279-892d-ca77ebda97c4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:51.424717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-306f46ea-d313-4279-892d-ca77ebda97c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:51.515509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:51.694536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f46ea-d313-4279-892d-ca77ebda97c4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:51.967221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:51.968155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:51.968685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:51.969177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:51.972538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:52.000163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:52.100179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:52.101883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f68209-71b8-4543-8a66-f6da0854cbf8 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:52.123831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 713/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:14:54.234799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908691-0c79-4f87-a9c5-64759acc075b None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:54.235873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908691-0c79-4f87-a9c5-64759acc075b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:54.236409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908691-0c79-4f87-a9c5-64759acc075b None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:54.238559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 691/1404] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:54.244197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9a9b-f6f9-40f0-a29b-96ac59157982 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:54.244789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9a9b-f6f9-40f0-a29b-96ac59157982 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:54.244883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9a9b-f6f9-40f0-a29b-96ac59157982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:54.359375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-40fe9a9b-f6f9-40f0-a29b-96ac59157982 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:54.360676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-40fe9a9b-f6f9-40f0-a29b-96ac59157982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:54.518360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:54.534350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 714/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:54.900234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6908691-0c79-4f87-a9c5-64759acc075b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:54.902944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b6908691-0c79-4f87-a9c5-64759acc075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:55.080838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:55.175184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6908691-0c79-4f87-a9c5-64759acc075b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:55.407411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:55.409809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:55.410497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:55.410991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:55.414133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:55.563670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:55.589464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:55.591892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b77e2-13bb-4166-903e-55e2d65aaae8 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:55.620874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 692/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:14:57.899970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac571d-0d2e-4260-9829-b69d1ef383bb None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:57.900566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac571d-0d2e-4260-9829-b69d1ef383bb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:57.901278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac571d-0d2e-4260-9829-b69d1ef383bb None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:57.905217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 715/1407] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:14:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:14:57.913268 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c094-7a95-40ae-b8a5-132bd70e3075 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:57.914067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c094-7a95-40ae-b8a5-132bd70e3075 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:57.914198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c094-7a95-40ae-b8a5-132bd70e3075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:58.028190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9937c094-7a95-40ae-b8a5-132bd70e3075 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:58.029546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9937c094-7a95-40ae-b8a5-132bd70e3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:58.224700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 693/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:58.540160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac571d-0d2e-4260-9829-b69d1ef383bb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:58.541789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d5ac571d-0d2e-4260-9829-b69d1ef383bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:58.782120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac571d-0d2e-4260-9829-b69d1ef383bb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:58.882717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:58.952071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:58.952960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:58.952960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:58.952960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:58.954625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:59.093736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:59.095407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d9bb6-ce9b-4432-b330-5de07a9d2f27 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:59.117554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 716/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:15:08.219300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=78 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:09.114338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=65 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:16.341410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e8ed-737a-4f4a-8f0b-d766a2b80436 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:16.341410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e8ed-737a-4f4a-8f0b-d766a2b80436 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:16.342977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e8ed-737a-4f4a-8f0b-d766a2b80436 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:16.343378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 694/1410] 10.222.0.57 () {54 vars in 918 bytes} [Thu Sep 1 05:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:16.350849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb09801-4090-4516-ac57-54bbede50a11 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:16.351473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb09801-4090-4516-ac57-54bbede50a11 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:16.351687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb09801-4090-4516-ac57-54bbede50a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:16.472643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7fb09801-4090-4516-ac57-54bbede50a11 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:16.474501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7fb09801-4090-4516-ac57-54bbede50a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:16.613147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 717/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Sep 1 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:16.638713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b637-bf68-497b-b169-cb284925675d None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:16.639156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b637-bf68-497b-b169-cb284925675d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:16.639598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b637-bf68-497b-b169-cb284925675d None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:16.642042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 695/1412] 10.222.0.57 () {54 vars in 918 bytes} [Thu Sep 1 05:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:16.650425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30232fc-476e-4a71-9c18-3374519c50e5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:16.650755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30232fc-476e-4a71-9c18-3374519c50e5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:16.650972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30232fc-476e-4a71-9c18-3374519c50e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:16.741257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:16.747046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a30232fc-476e-4a71-9c18-3374519c50e5 None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:16.749722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a30232fc-476e-4a71-9c18-3374519c50e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:16.920300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 718/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Sep 1 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:19.455998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065973ae-128e-4598-b6cb-e74726753f47 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:19.456723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065973ae-128e-4598-b6cb-e74726753f47 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:19.456723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065973ae-128e-4598-b6cb-e74726753f47 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:19.457988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:19.464172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f2b6-77b0-4c71-8a0c-efbd89f5d683 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:19.465027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f2b6-77b0-4c71-8a0c-efbd89f5d683 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:19.465027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f2b6-77b0-4c71-8a0c-efbd89f5d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:19.549734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0226f2b6-77b0-4c71-8a0c-efbd89f5d683 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:19.551312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0226f2b6-77b0-4c71-8a0c-efbd89f5d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:19.618374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:19.672612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:19.979609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065973ae-128e-4598-b6cb-e74726753f47 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:19.981500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-065973ae-128e-4598-b6cb-e74726753f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:20.173143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065973ae-128e-4598-b6cb-e74726753f47 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:20.268875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:20.334079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:20.334702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:20.334982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:20.335247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:20.337024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:20.462919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:20.464999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2d61e-f647-4796-95dd-cccbc8fc8a50 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:20.491841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 697/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:21.477584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a7bee-7e35-46e9-897b-11003f7c950a None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:21.478430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a7bee-7e35-46e9-897b-11003f7c950a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:21.478430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a7bee-7e35-46e9-897b-11003f7c950a None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:21.480015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:21.486500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205c93-87ac-4dfa-b12b-f097e9597459 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:21.487152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205c93-87ac-4dfa-b12b-f097e9597459 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:21.487152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205c93-87ac-4dfa-b12b-f097e9597459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:21.596386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-32205c93-87ac-4dfa-b12b-f097e9597459 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:21.598432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-32205c93-87ac-4dfa-b12b-f097e9597459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:21.641011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:21.731505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:21.989083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a7bee-7e35-46e9-897b-11003f7c950a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:21.990804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-203a7bee-7e35-46e9-897b-11003f7c950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:22.206005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a7bee-7e35-46e9-897b-11003f7c950a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:22.258788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:22.353235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:22.353868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:22.354139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:22.354402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:22.356152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:22.469900 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:22.471575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc0896-5a86-4d5f-bd37-f7d06e634ffe service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:22.493759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 721/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:23.499891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1663e8-e3df-447a-9e8e-a1b09e3b1880 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:23.500609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1663e8-e3df-447a-9e8e-a1b09e3b1880 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:23.500609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1663e8-e3df-447a-9e8e-a1b09e3b1880 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:23.502062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:23.510766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910771-5553-4748-ac51-460dc11c79c3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:23.511691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910771-5553-4748-ac51-460dc11c79c3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:23.511691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910771-5553-4748-ac51-460dc11c79c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:23.579573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:23.617462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-78910771-5553-4748-ac51-460dc11c79c3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:23.618765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-78910771-5553-4748-ac51-460dc11c79c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:23.743897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:23.905126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1663e8-e3df-447a-9e8e-a1b09e3b1880 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:23.906721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4b1663e8-e3df-447a-9e8e-a1b09e3b1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:24.190442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1663e8-e3df-447a-9e8e-a1b09e3b1880 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:24.215509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:24.374397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:24.375441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:24.375912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:24.376388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:24.379898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:24.556779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:24.559684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd292e51-179e-4b7a-bd99-2f56f88d841f service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:24.596312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 700/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:15:25.540523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633aa5-bb17-4f0c-ba77-99060a069f20 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:25.541206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633aa5-bb17-4f0c-ba77-99060a069f20 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:25.541206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633aa5-bb17-4f0c-ba77-99060a069f20 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:25.542992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:25.549352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ace0bd-d966-4da3-99f5-74c72459e48f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:25.549786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ace0bd-d966-4da3-99f5-74c72459e48f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:25.550108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ace0bd-d966-4da3-99f5-74c72459e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:25.573221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:25.647624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-87ace0bd-d966-4da3-99f5-74c72459e48f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:25.649241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-87ace0bd-d966-4da3-99f5-74c72459e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:25.779536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:25.940866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a633aa5-bb17-4f0c-ba77-99060a069f20 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:25.942430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5a633aa5-bb17-4f0c-ba77-99060a069f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:26.091272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:26.135820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a633aa5-bb17-4f0c-ba77-99060a069f20 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:26.278312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:26.278984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:26.279326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:26.280316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:26.282093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:26.377912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:26.394718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:26.396378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c68ec0-a5ef-4af2-9ad0-959e12547c31 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:26.417609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 724/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:27.335085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6ccb-1035-4647-b655-4c9581d4a2e7 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:27.335767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6ccb-1035-4647-b655-4c9581d4a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:27.335767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6ccb-1035-4647-b655-4c9581d4a2e7 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:27.337102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:27.343426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aaf4b-8264-42db-99c0-0bd0768a8040 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:27.344032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aaf4b-8264-42db-99c0-0bd0768a8040 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:27.344138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aaf4b-8264-42db-99c0-0bd0768a8040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:27.443863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ad5aaf4b-8264-42db-99c0-0bd0768a8040 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:27.445261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ad5aaf4b-8264-42db-99c0-0bd0768a8040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:27.561932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:27.714280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6ccb-1035-4647-b655-4c9581d4a2e7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:27.715743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fc1f6ccb-1035-4647-b655-4c9581d4a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:27.819346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:27.895561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f6ccb-1035-4647-b655-4c9581d4a2e7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:28.033781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:28.034315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:28.034588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:28.034845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:28.036561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:28.094958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:28.145147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:28.146812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a4405-71bd-4781-b8a7-5fa0044f8bdf service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:28.167871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 703/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:29.024918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6b46-80a0-423f-b624-adff306d0a6e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:29.025779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6b46-80a0-423f-b624-adff306d0a6e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:29.025779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6b46-80a0-423f-b624-adff306d0a6e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:29.026858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:29.033277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf41c-37b1-472b-bffe-976dad067d07 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:29.034084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf41c-37b1-472b-bffe-976dad067d07 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:29.034084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf41c-37b1-472b-bffe-976dad067d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:29.132567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b9cbf41c-37b1-472b-bffe-976dad067d07 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:29.133984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b9cbf41c-37b1-472b-bffe-976dad067d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:29.318367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:29.477065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6b46-80a0-423f-b624-adff306d0a6e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:29.478826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7daf6b46-80a0-423f-b624-adff306d0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:29.540948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:29.665594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6b46-80a0-423f-b624-adff306d0a6e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:29.852758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:29.853808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:29.854293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:29.854773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:29.859188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:29.872446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.044162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.046480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721afce-8a30-4d1a-98ab-4b378ff04e10 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.068862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 727/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:30.941969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34b2d-30dd-4b40-a3d2-ca1cb0cbd4fe None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.942840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34b2d-30dd-4b40-a3d2-ca1cb0cbd4fe None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.942840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34b2d-30dd-4b40-a3d2-ca1cb0cbd4fe None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.944361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:30.950771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7fc2-cf7e-4633-988b-283203127121 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.951187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7fc2-cf7e-4633-988b-283203127121 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.951545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7fc2-cf7e-4633-988b-283203127121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:31.046431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b8fb7fc2-cf7e-4633-988b-283203127121 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:31.047757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b8fb7fc2-cf7e-4633-988b-283203127121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:31.148019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:31.185407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:31.342531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34b2d-30dd-4b40-a3d2-ca1cb0cbd4fe None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:31.344200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c0a34b2d-30dd-4b40-a3d2-ca1cb0cbd4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:31.365816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:31.530994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34b2d-30dd-4b40-a3d2-ca1cb0cbd4fe None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:31.649834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:31.688337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:31.689345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:31.689751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:31.690149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:31.692827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:31.810722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:31.814717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe043c6-d8c7-43e0-86a1-9f058817da66 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:31.836957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 706/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:32.713081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03e24-ca31-4dbe-99e3-4fb114615404 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:32.713692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03e24-ca31-4dbe-99e3-4fb114615404 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:32.713692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03e24-ca31-4dbe-99e3-4fb114615404 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:32.715305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:32.721587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf33e3-5c45-4de3-92d4-bede3baf599f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:32.722472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf33e3-5c45-4de3-92d4-bede3baf599f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:32.722472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf33e3-5c45-4de3-92d4-bede3baf599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:32.817832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f0bf33e3-5c45-4de3-92d4-bede3baf599f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:32.819084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f0bf33e3-5c45-4de3-92d4-bede3baf599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:32.869347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:32.937347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:33.096010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f03e24-ca31-4dbe-99e3-4fb114615404 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:33.097639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b1f03e24-ca31-4dbe-99e3-4fb114615404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:33.291696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f03e24-ca31-4dbe-99e3-4fb114615404 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:33.363976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:33.448112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:33.448775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:33.449054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:33.449318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:33.451091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:33.570787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:33.572748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ead2e-0163-42ab-a6a4-863811f53bbb service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:33.600327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 730/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:15:34.490379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6d18-cb00-41ec-b2fe-bf9c7b97057f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:34.491166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6d18-cb00-41ec-b2fe-bf9c7b97057f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:34.491166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6d18-cb00-41ec-b2fe-bf9c7b97057f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:34.493013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:15:34.499671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3fc9-2a26-493c-b0e8-bd24d8298923 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:34.500299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3fc9-2a26-493c-b0e8-bd24d8298923 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:34.500299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3fc9-2a26-493c-b0e8-bd24d8298923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:34.621416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-60ba3fc9-2a26-493c-b0e8-bd24d8298923 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:34.623442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-60ba3fc9-2a26-493c-b0e8-bd24d8298923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:34.626452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:34.777752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:34.939011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed6d18-cb00-41ec-b2fe-bf9c7b97057f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:34.940575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aaed6d18-cb00-41ec-b2fe-bf9c7b97057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:35.160519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed6d18-cb00-41ec-b2fe-bf9c7b97057f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:35.206145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:35.320054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:35.320719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:35.321001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:35.321271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:35.323053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:35.458093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:35.459771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183b86-5c29-4394-b629-a28127fd6f4b service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:35.481972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 709/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:37.479777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5c43-d606-4c1f-8709-a6072f7dcfe7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:37.480394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5c43-d606-4c1f-8709-a6072f7dcfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:37.480394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f5c43-d606-4c1f-8709-a6072f7dcfe7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:37.481931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:37.488511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b997828-7cf3-4b61-bca0-ae773d865185 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:37.489290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b997828-7cf3-4b61-bca0-ae773d865185 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:37.489290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b997828-7cf3-4b61-bca0-ae773d865185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:37.539183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:37.579721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6b997828-7cf3-4b61-bca0-ae773d865185 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:37.581808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6b997828-7cf3-4b61-bca0-ae773d865185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:37.734338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:38.042574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f5c43-d606-4c1f-8709-a6072f7dcfe7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:38.044159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f56f5c43-d606-4c1f-8709-a6072f7dcfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:38.184794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f5c43-d606-4c1f-8709-a6072f7dcfe7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:38.225566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:38.282030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:38.282702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:38.282996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:38.283344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:38.285175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:38.427368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:38.429168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38c009-8938-4e98-8885-59e9e9384ee5 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:38.454348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 733/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:40.781530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930127-8dd3-421f-82f4-2fa39b44a75c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.782189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930127-8dd3-421f-82f4-2fa39b44a75c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.782189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930127-8dd3-421f-82f4-2fa39b44a75c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.783669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:40.790252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d2553-af11-4b11-b4c5-83245d715d51 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.790839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d2553-af11-4b11-b4c5-83245d715d51 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.790839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d2553-af11-4b11-b4c5-83245d715d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.876883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7a1d2553-af11-4b11-b4c5-83245d715d51 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:40.878035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7a1d2553-af11-4b11-b4c5-83245d715d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:40.894657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:41.013002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:41.306509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930127-8dd3-421f-82f4-2fa39b44a75c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.308291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d3930127-8dd3-421f-82f4-2fa39b44a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:41.448367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930127-8dd3-421f-82f4-2fa39b44a75c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.466852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:41.550977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.551614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.551932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.552208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.554000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:41.700030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.701753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2052774-8e10-4ea7-8e21-a4475127c5bc service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.725076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 712/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:44.142395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570948b-4080-4f8a-b040-4bd8ecd8eedf None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.143259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570948b-4080-4f8a-b040-4bd8ecd8eedf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.143259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570948b-4080-4f8a-b040-4bd8ecd8eedf None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.145172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:44.151373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1f0d-0813-4a71-9459-1c5c14e6488c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.152221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1f0d-0813-4a71-9459-1c5c14e6488c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.152221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1f0d-0813-4a71-9459-1c5c14e6488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.214094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:44.239066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-021f1f0d-0813-4a71-9459-1c5c14e6488c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:44.240374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-021f1f0d-0813-4a71-9459-1c5c14e6488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:44.370900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:44.674135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570948b-4080-4f8a-b040-4bd8ecd8eedf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:44.675837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7570948b-4080-4f8a-b040-4bd8ecd8eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:44.801390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570948b-4080-4f8a-b040-4bd8ecd8eedf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:44.853175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:44.898040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:44.898712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.899021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.899324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.901112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:45.039322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:45.040850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0160b-accc-42e4-8254-dad3fd7f7d79 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:45.064960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 736/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:47.436316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31327a-4ed0-40de-a1c9-4ff4ae090d14 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:47.437156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31327a-4ed0-40de-a1c9-4ff4ae090d14 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:47.437156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31327a-4ed0-40de-a1c9-4ff4ae090d14 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:47.438683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:47.446194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba53c2-d5d9-40de-bfa4-271006f70e57 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:47.447386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba53c2-d5d9-40de-bfa4-271006f70e57 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:47.447731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba53c2-d5d9-40de-bfa4-271006f70e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:47.542377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8cba53c2-d5d9-40de-bfa4-271006f70e57 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:47.543708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8cba53c2-d5d9-40de-bfa4-271006f70e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:47.570591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:47.711690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:48.037643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31327a-4ed0-40de-a1c9-4ff4ae090d14 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:48.040357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0e31327a-4ed0-40de-a1c9-4ff4ae090d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:48.179249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31327a-4ed0-40de-a1c9-4ff4ae090d14 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:48.203952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:48.300305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:48.301269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:48.301704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:48.302118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:48.305222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:48.488307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:48.489917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf8e8-c81c-4449-8948-3bb58a36e0e6 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:48.512322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 715/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:50.614860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b516b-fe4e-4285-9630-da3ae835b727 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:50.615563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b516b-fe4e-4285-9630-da3ae835b727 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:50.615563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b516b-fe4e-4285-9630-da3ae835b727 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:50.617214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:50.624225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77616953-c43a-499e-9b55-8f5469bb09ec None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:50.624905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77616953-c43a-499e-9b55-8f5469bb09ec None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:50.624905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77616953-c43a-499e-9b55-8f5469bb09ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:50.712688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:50.717153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-77616953-c43a-499e-9b55-8f5469bb09ec None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:50.719408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-77616953-c43a-499e-9b55-8f5469bb09ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:50.845139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:51.368781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b516b-fe4e-4285-9630-da3ae835b727 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:51.370323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-276b516b-fe4e-4285-9630-da3ae835b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:51.501967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b516b-fe4e-4285-9630-da3ae835b727 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:51.564373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:51.595162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:51.595800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:51.596061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:51.596327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:51.598145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:51.737594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:51.738989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6973e7-a2ba-471e-8b2c-d6200fab333d service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:51.760761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 739/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:53.945116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fab249-13e4-4332-89c5-c78d2bb66468 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.946013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fab249-13e4-4332-89c5-c78d2bb66468 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.946013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fab249-13e4-4332-89c5-c78d2bb66468 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.947705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:53.955445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029069c-c8c3-4b4c-b579-5ce3361413c3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.956345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029069c-c8c3-4b4c-b579-5ce3361413c3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.956345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029069c-c8c3-4b4c-b579-5ce3361413c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:54.041212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5029069c-c8c3-4b4c-b579-5ce3361413c3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:54.042662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5029069c-c8c3-4b4c-b579-5ce3361413c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:54.082022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:54.178185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:54.491044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fab249-13e4-4332-89c5-c78d2bb66468 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:54.493418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-67fab249-13e4-4332-89c5-c78d2bb66468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:54.673468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fab249-13e4-4332-89c5-c78d2bb66468 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:54.718209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:54.781518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:54.782189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:54.782470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:54.782738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:54.784453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:54.931792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:54.934144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217587-f592-4fed-8ab3-c68f6c222956 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:54.961665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 718/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:15:57.514036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c503b-6450-4de6-a519-0776ecb3bcbe None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:57.514729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c503b-6450-4de6-a519-0776ecb3bcbe None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:57.514729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c503b-6450-4de6-a519-0776ecb3bcbe None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:57.516215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:15:57.522794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18a8b3-7870-4b54-ba7b-afea6858711b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:57.523435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18a8b3-7870-4b54-ba7b-afea6858711b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:57.523435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18a8b3-7870-4b54-ba7b-afea6858711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:57.596648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9c18a8b3-7870-4b54-ba7b-afea6858711b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:57.597873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9c18a8b3-7870-4b54-ba7b-afea6858711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:57.607119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:57.726876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:58.022743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c503b-6450-4de6-a519-0776ecb3bcbe None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:58.025446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a17c503b-6450-4de6-a519-0776ecb3bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:58.214452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c503b-6450-4de6-a519-0776ecb3bcbe None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:58.293505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:58.317443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:58.318071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:58.318350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:58.318623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:58.320300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:58.481221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:58.482798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591283c0-0d75-48cb-8752-282ad2d78ea0 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:58.505827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 742/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:00.799415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351b2b-8ba3-408c-92cf-e749edd062b2 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:00.800058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351b2b-8ba3-408c-92cf-e749edd062b2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:00.800058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351b2b-8ba3-408c-92cf-e749edd062b2 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:00.801591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:16:00.808063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a3d5-7b44-4450-98f5-2e9144a3766a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:00.808709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a3d5-7b44-4450-98f5-2e9144a3766a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:00.808709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a3d5-7b44-4450-98f5-2e9144a3766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:00.889171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a995a3d5-7b44-4450-98f5-2e9144a3766a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:00.890486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a995a3d5-7b44-4450-98f5-2e9144a3766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:00.938972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:01.010830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:16:01.297477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40351b2b-8ba3-408c-92cf-e749edd062b2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:01.299074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-40351b2b-8ba3-408c-92cf-e749edd062b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:01.430528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40351b2b-8ba3-408c-92cf-e749edd062b2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:01.475363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:01.520479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:01.521230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:01.521706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:01.522174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:01.523870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:01.660832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:01.662272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaabc9-cb28-4ef2-abd3-8fa3e4b3eb59 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:01.686211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 721/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:03.787353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c239d29-e80f-4e89-91d6-178cd12c390e None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.787967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c239d29-e80f-4e89-91d6-178cd12c390e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.788329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c239d29-e80f-4e89-91d6-178cd12c390e None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.790981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:03.797608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bed7-0a57-479e-ad81-44b20e5b87b4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.798194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bed7-0a57-479e-ad81-44b20e5b87b4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.798194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bed7-0a57-479e-ad81-44b20e5b87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.891467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1098bed7-0a57-479e-ad81-44b20e5b87b4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:03.892711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1098bed7-0a57-479e-ad81-44b20e5b87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:03.915960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:04.016206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:04.309971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c239d29-e80f-4e89-91d6-178cd12c390e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.311656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7c239d29-e80f-4e89-91d6-178cd12c390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:04.499457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c239d29-e80f-4e89-91d6-178cd12c390e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.711860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:04.722222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.722902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.723225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.723538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.725454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:04.883659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.886435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d2f18-4f73-4ea7-936c-38e703672e74 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.923601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 745/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:07.007187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd37a0-ddff-463c-8330-ce0f47a7a9a5 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:07.008036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd37a0-ddff-463c-8330-ce0f47a7a9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:07.008036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd37a0-ddff-463c-8330-ce0f47a7a9a5 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:07.009374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:16:07.017787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d53e-a0dc-4436-8d8f-b2a23caa37f6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:07.018368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d53e-a0dc-4436-8d8f-b2a23caa37f6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:07.018623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d53e-a0dc-4436-8d8f-b2a23caa37f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:07.140985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-58f6d53e-a0dc-4436-8d8f-b2a23caa37f6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:07.143042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-58f6d53e-a0dc-4436-8d8f-b2a23caa37f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:07.214529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:07.312676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:07.851363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd37a0-ddff-463c-8330-ce0f47a7a9a5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:07.853181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d9cd37a0-ddff-463c-8330-ce0f47a7a9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:07.987803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd37a0-ddff-463c-8330-ce0f47a7a9a5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:08.046510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:08.081625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:08.082395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:08.082731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:08.083004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:08.084957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:08.262123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:08.264187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c8933-2925-40f2-812d-cc9a4be54f76 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:08.291120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 724/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:17.307747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=22 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:18.287573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=66 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:30.074253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5b762-5852-4c24-8e3b-7776ad55d846 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:30.074975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5b762-5852-4c24-8e3b-7776ad55d846 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:30.074975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5b762-5852-4c24-8e3b-7776ad55d846 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:30.076839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 747/1471] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:30.083808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362f7b-a948-4e84-afe1-ca9a316a83d8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:30.084689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362f7b-a948-4e84-afe1-ca9a316a83d8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:30.084906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362f7b-a948-4e84-afe1-ca9a316a83d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:30.168368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ad362f7b-a948-4e84-afe1-ca9a316a83d8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:30.169905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ad362f7b-a948-4e84-afe1-ca9a316a83d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:30.295136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 725/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:30.609100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b740d-c5c0-41dc-8a92-8f8deb6f69aa None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:30.609506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b740d-c5c0-41dc-8a92-8f8deb6f69aa None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:30.609883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b740d-c5c0-41dc-8a92-8f8deb6f69aa None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:30.611548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 748/1473] 10.222.0.57 () {54 vars in 967 bytes} [Thu Sep 1 05:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:30.617626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ed57-feed-476f-a0a1-e277c0ebf76f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:30.618053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ed57-feed-476f-a0a1-e277c0ebf76f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:30.618432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ed57-feed-476f-a0a1-e277c0ebf76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:30.720094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7e29ed57-feed-476f-a0a1-e277c0ebf76f None None] MFA Rules not processed for user `a847910274f346d5b0320b725599b14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:30.721437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7e29ed57-feed-476f-a0a1-e277c0ebf76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:30.749502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:30.821784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 726/1474] 10.222.0.57 () {58 vars in 1064 bytes} [Thu Sep 1 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:16:30.830592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b740d-c5c0-41dc-8a92-8f8deb6f69aa None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:30.832310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac9b740d-c5c0-41dc-8a92-8f8deb6f69aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:30.978994 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b740d-c5c0-41dc-8a92-8f8deb6f69aa None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:31.094813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:31.095587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:31.095755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:31.095892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:31.097606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:31.171025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:31.242096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:31.243573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ba368-69ef-42a2-bf32-0838917c34d9 service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:31.266423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 749/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:33.429513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7f73-fdbc-46a0-95b4-46fdf23d48c9 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:33.430386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7f73-fdbc-46a0-95b4-46fdf23d48c9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:33.430544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7f73-fdbc-46a0-95b4-46fdf23d48c9 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:33.433188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 727/1476] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:33.442769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b690-65b6-4795-b1bf-d8ff5d160237 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:33.443597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b690-65b6-4795-b1bf-d8ff5d160237 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:33.443597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b690-65b6-4795-b1bf-d8ff5d160237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:33.523896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-82d2b690-65b6-4795-b1bf-d8ff5d160237 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:33.525450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-82d2b690-65b6-4795-b1bf-d8ff5d160237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:33.659462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 750/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:16:33.948456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7f73-fdbc-46a0-95b4-46fdf23d48c9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:33.950191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5bf7f73-fdbc-46a0-95b4-46fdf23d48c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:34.103710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7f73-fdbc-46a0-95b4-46fdf23d48c9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:34.167783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:34.258010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:34.259081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:34.259558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:34.260017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:34.261261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:34.264653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:16:34.264653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:16:34.264653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:16:34.266984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7fcc2-6a89-4bb1-87ef-1fee72993f26 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:34.302743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 728/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:33 2022] GET /identity/v3/projects => generated 2553 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:36.437231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d417-d03f-42a5-bde9-b1b021af8a6f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:36.437903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d417-d03f-42a5-bde9-b1b021af8a6f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:36.438167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d417-d03f-42a5-bde9-b1b021af8a6f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:36.440799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 751/1479] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:36.447030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf393-ea83-4fb8-a837-fabbf4a661ae None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:36.447632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf393-ea83-4fb8-a837-fabbf4a661ae None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:36.447632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bf393-ea83-4fb8-a837-fabbf4a661ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:36.533022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f88bf393-ea83-4fb8-a837-fabbf4a661ae None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:36.534593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f88bf393-ea83-4fb8-a837-fabbf4a661ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:36.786134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 729/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:37.086824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d417-d03f-42a5-bde9-b1b021af8a6f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:37.089993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-62f5d417-d03f-42a5-bde9-b1b021af8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:37.108914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:37.300388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d417-d03f-42a5-bde9-b1b021af8a6f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:37.415031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:37.468450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:37.469269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:37.469405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:37.469797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:37.471664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:37.609667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:37.612267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9cb7b-a80b-46a1-8c9a-5e63c01e6f7b service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:37.635033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 752/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:39.915632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f343c-b240-49da-94a1-d4ea68305d09 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:39.916386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f343c-b240-49da-94a1-d4ea68305d09 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:39.916386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f343c-b240-49da-94a1-d4ea68305d09 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:39.918416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 730/1482] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:39.925187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c389a-8eab-4120-a26b-316c150bcf4c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:39.926048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c389a-8eab-4120-a26b-316c150bcf4c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:39.926048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c389a-8eab-4120-a26b-316c150bcf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:40.038790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-358c389a-8eab-4120-a26b-316c150bcf4c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:40.040781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-358c389a-8eab-4120-a26b-316c150bcf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:40.126932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:40.195597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 753/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:40.511937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f343c-b240-49da-94a1-d4ea68305d09 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:40.514349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ec0f343c-b240-49da-94a1-d4ea68305d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:40.542866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:40.660856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f343c-b240-49da-94a1-d4ea68305d09 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:40.753160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:40.754143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:40.754420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:40.754715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:40.756502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:40.853561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:40.898739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:40.900215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd16998-bcd6-4cc4-aedf-d5f175ae2ac5 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:40.926239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 731/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:43.045719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017d72-85d4-4731-8387-88dab4486859 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:43.046452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017d72-85d4-4731-8387-88dab4486859 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:43.046452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017d72-85d4-4731-8387-88dab4486859 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:43.047677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 754/1485] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:43.057453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ed51-6cbe-4668-8fe8-7b02d4835362 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:43.058374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ed51-6cbe-4668-8fe8-7b02d4835362 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:43.058553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ed51-6cbe-4668-8fe8-7b02d4835362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:43.179731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d498ed51-6cbe-4668-8fe8-7b02d4835362 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:43.181219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d498ed51-6cbe-4668-8fe8-7b02d4835362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:43.304030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 732/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:43.609502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63017d72-85d4-4731-8387-88dab4486859 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:43.611817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-63017d72-85d4-4731-8387-88dab4486859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:43.747637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63017d72-85d4-4731-8387-88dab4486859 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:43.839885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:43.842293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:43.842981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:43.843294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:43.843567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:43.845768 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:43.984949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:43.986422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952ac7c-8a4e-4fc5-9fde-1157549c700f service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:44.015603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 755/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:16:46.835204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4898fd0-9704-4122-99d8-f19f50a21ee9 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.836134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4898fd0-9704-4122-99d8-f19f50a21ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.836134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4898fd0-9704-4122-99d8-f19f50a21ee9 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.837943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 733/1488] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:16:46.845323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dbcdc-1ba4-4a8f-8b36-8a2d46187ddb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.845937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dbcdc-1ba4-4a8f-8b36-8a2d46187ddb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.846195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dbcdc-1ba4-4a8f-8b36-8a2d46187ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.930902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bf1dbcdc-1ba4-4a8f-8b36-8a2d46187ddb None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:46.932164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bf1dbcdc-1ba4-4a8f-8b36-8a2d46187ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:47.019585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.084686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 756/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:16:47.443340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4898fd0-9704-4122-99d8-f19f50a21ee9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.444898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c4898fd0-9704-4122-99d8-f19f50a21ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:47.490441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.573272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4898fd0-9704-4122-99d8-f19f50a21ee9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.667505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.668144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.668418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.668730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.670602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:47.775437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.813459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:47.814943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf92e0-b12e-49bc-8120-5ba61e43d86d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:47.837866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 734/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:50.292513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2801d-024a-401d-b0ed-ecb9196493d9 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:50.294189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2801d-024a-401d-b0ed-ecb9196493d9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:50.294189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2801d-024a-401d-b0ed-ecb9196493d9 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:50.295392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 757/1491] 10.222.0.57 () {54 vars in 927 bytes} [Thu Sep 1 05:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:50.302548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2c097-5bc3-4425-accf-a5f07eb062d9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:50.303546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2c097-5bc3-4425-accf-a5f07eb062d9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:50.303546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2c097-5bc3-4425-accf-a5f07eb062d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:50.393881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-08e2c097-5bc3-4425-accf-a5f07eb062d9 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:50.395133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08e2c097-5bc3-4425-accf-a5f07eb062d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:50.518942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 735/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:16:50.829273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2801d-024a-401d-b0ed-ecb9196493d9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:50.830887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3ea2801d-024a-401d-b0ed-ecb9196493d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:50.959550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2801d-024a-401d-b0ed-ecb9196493d9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:51.054306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:51.054930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:51.055204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:51.055469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:51.057226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:51.068513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:51.199881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:51.201938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667cc89-2073-4e93-a13f-5ee26cb534be service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:51.225609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 758/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:00.516636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:01.222427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=50 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.482597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.483533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.483533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.582118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:28.583356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:28.716408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 736/1494] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:28.731567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.732176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.732176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.758623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:28.761219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:28.776231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 759/1495] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:28.781534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.792386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb82a61-bcdb-4fc4-aca8-c9e00410713d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.797556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.798174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.798471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.798725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.799383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:28.799688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.800751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:28.800751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:18:28.800751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:18:28.801658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.815306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 737/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:28.824577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.834236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2141c-809f-4ab2-b8a4-817054223275 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.839141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.839772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.840087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.840301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.841005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.842817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:28.842817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:18:28.842817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:18:28.844024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.888663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 760/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:28 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:28.893331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.904492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3231cbc-04d4-4841-925e-11edb0d45ade admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.964883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.972362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.972925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.973200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.973468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.974198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.975305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:28.975305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:18:28.975305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:18:28.976613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.001688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 738/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:28 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:29.006477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.018653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffb4bb-300b-4e53-9642-85a167d5a53a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.024718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.025458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.025603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.025857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.026519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.027602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:29.027602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:18:29.027602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:18:29.028679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.047083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 761/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:29.051744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.062910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0660c-00a0-4448-8153-584565d8bb10 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.068395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.069228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.069560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.069871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.070578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.071862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:29.071862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:18:29.071862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:18:29.072953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fd045-3587-4f18-9cda-8eab548359a4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.094730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 739/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:29.099523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.110508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8c269-fdea-46a4-95d7-65daca7443e2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.115795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.116498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.116811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.117122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] PATH_INFO: `/v3/projects/3c17141f60864890b0bfa257de23eba1/users/8abcc2bbf16e473e82a37017e1a883d0/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.139247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c17141f60864890b0bfa257de23eba1, user_id=8abcc2bbf16e473e82a37017e1a883d0, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.140546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:29.140546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:18:29.140546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:18:29.142880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d014-f60d-4440-a845-66a45a7fa049 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.162411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 762/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:29 2022] PUT /identity/v3/projects/3c17141f60864890b0bfa257de23eba1/users/8abcc2bbf16e473e82a37017e1a883d0/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:29.182907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545dfa64-cac9-40cd-a02a-30d741a960da None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.183243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545dfa64-cac9-40cd-a02a-30d741a960da None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.183489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545dfa64-cac9-40cd-a02a-30d741a960da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.225469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-545dfa64-cac9-40cd-a02a-30d741a960da None None] MFA Rules not processed for user `8abcc2bbf16e473e82a37017e1a883d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:29.226595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-545dfa64-cac9-40cd-a02a-30d741a960da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:29.327098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 740/1502] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:18:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:18:29.343091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934a3bc-29f1-4811-b69f-badabfaa10d7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.343362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934a3bc-29f1-4811-b69f-badabfaa10d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.343630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934a3bc-29f1-4811-b69f-badabfaa10d7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.345122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 763/1503] 10.222.0.57 () {54 vars in 964 bytes} [Thu Sep 1 05:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:29.352122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72a89-41f0-40b2-8df4-217f97361481 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.352405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72a89-41f0-40b2-8df4-217f97361481 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.353132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72a89-41f0-40b2-8df4-217f97361481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.432360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aba72a89-41f0-40b2-8df4-217f97361481 None None] MFA Rules not processed for user `9266a63ee919403f880344cfe2efb5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:29.433661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aba72a89-41f0-40b2-8df4-217f97361481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:29.533704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 741/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Sep 1 05:18:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:29.544763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934a3bc-29f1-4811-b69f-badabfaa10d7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.557786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934a3bc-29f1-4811-b69f-badabfaa10d7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.561936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.562771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.563165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.563515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.574692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.576160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.586937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 764/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:18:29.643849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e83e6c-c854-4f6a-b03b-b805924050be None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.644808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e83e6c-c854-4f6a-b03b-b805924050be None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.644926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e83e6c-c854-4f6a-b03b-b805924050be None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.647316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 742/1506] 10.222.0.57 () {52 vars in 830 bytes} [Thu Sep 1 05:18:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:29.653674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.729791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c5da1-2043-49ad-9b85-277510efb6a3 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.734879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.735579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.735798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.736069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] PATH_INFO: `/v3/users/8abcc2bbf16e473e82a37017e1a883d0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.737286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abcc2bbf16e473e82a37017e1a883d0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.738325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:29.738325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:18:29.738325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:18:29.739550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.827097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abcc2bbf16e473e82a37017e1a883d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:29.828283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abcc2bbf16e473e82a37017e1a883d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:29.842658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abcc2bbf16e473e82a37017e1a883d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:29.872933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abcc2bbf16e473e82a37017e1a883d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:29.888247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:29.894950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abcc2bbf16e473e82a37017e1a883d0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:29.904974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 765/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:29 2022] DELETE /identity/v3/users/8abcc2bbf16e473e82a37017e1a883d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:29.909995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.910443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.910654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.936166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:29.938337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:29.956151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.044359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 743/1508] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:30.056391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.058196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:30.157255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02fa1-29bb-443a-8d49-37f33e634ff6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.161213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda71bfe-362c-4a48-a5b7-6d5c6b2d6980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.161875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71bfe-362c-4a48-a5b7-6d5c6b2d6980 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.162150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71bfe-362c-4a48-a5b7-6d5c6b2d6980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.162422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71bfe-362c-4a48-a5b7-6d5c6b2d6980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.173630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71bfe-362c-4a48-a5b7-6d5c6b2d6980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.175316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71bfe-362c-4a48-a5b7-6d5c6b2d6980 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.186804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 766/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:30.605890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.608141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:30.630881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfed01-c479-408f-b55b-ad589323a15e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.637454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.638299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.638764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.639298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] PATH_INFO: `/v3/projects/3c17141f60864890b0bfa257de23eba1` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.641869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c17141f60864890b0bfa257de23eba1)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.644596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:18:30.644596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:18:30.644596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:18:30.646948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.733849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c17141f60864890b0bfa257de23eba1', 'request_id': 'req-bfe8ff00-93ec-4687-aa46-258dc62096bd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.745469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c17141f60864890b0bfa257de23eba1', 'request_id': 'req-bfe8ff00-93ec-4687-aa46-258dc62096bd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.762156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c17141f60864890b0bfa257de23eba1', 'request_id': 'req-bfe8ff00-93ec-4687-aa46-258dc62096bd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.790024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] The token cache is being invalidate because project 3c17141f60864890b0bfa257de23eba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:30.790365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.791207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-bfe8ff00-93ec-4687-aa46-258dc62096bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.792869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 744/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:30 2022] DELETE /identity/v3/projects/3c17141f60864890b0bfa257de23eba1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:40.182000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=38 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.786055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:09.759837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410c50a-8949-4916-add1-3a1c404b113f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:09.760543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410c50a-8949-4916-add1-3a1c404b113f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:09.760543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410c50a-8949-4916-add1-3a1c404b113f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:09.762215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:09.768351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9407-0221-4563-8b0b-2e3dcc41a5d2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:09.769047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9407-0221-4563-8b0b-2e3dcc41a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:09.769047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9407-0221-4563-8b0b-2e3dcc41a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:09.792015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a25f9407-0221-4563-8b0b-2e3dcc41a5d2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:09.793349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a25f9407-0221-4563-8b0b-2e3dcc41a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:09.866154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:10.045313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410c50a-8949-4916-add1-3a1c404b113f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:10.047984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f410c50a-8949-4916-add1-3a1c404b113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:10.178973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410c50a-8949-4916-add1-3a1c404b113f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:10.185995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4a299-ef8c-4b77-adad-615606c4c5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:10.186783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a299-ef8c-4b77-adad-615606c4c5be service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:10.187157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a299-ef8c-4b77-adad-615606c4c5be service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:10.187525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4a299-ef8c-4b77-adad-615606c4c5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:10.198019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4a299-ef8c-4b77-adad-615606c4c5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:10.199644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4a299-ef8c-4b77-adad-615606c4c5be service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:10.211222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 768/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:11.098317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9c97-33bb-4412-a9dc-05ea8a092c82 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.098971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9c97-33bb-4412-a9dc-05ea8a092c82 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.099596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c9c97-33bb-4412-a9dc-05ea8a092c82 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.101426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:11.107115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a3f68-92a5-41ea-925f-3ecc48dc7bfe None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.107780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a3f68-92a5-41ea-925f-3ecc48dc7bfe None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.107780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a3f68-92a5-41ea-925f-3ecc48dc7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.130880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d23a3f68-92a5-41ea-925f-3ecc48dc7bfe None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:11.132744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d23a3f68-92a5-41ea-925f-3ecc48dc7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:11.141300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:11.305002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d064e-9352-4c66-b49e-c101a0fb0823 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.305371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d064e-9352-4c66-b49e-c101a0fb0823 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.305859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d064e-9352-4c66-b49e-c101a0fb0823 None None] PATH_INFO: `/v3` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.308548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 747/1516] 10.222.0.55 () {54 vars in 925 bytes} [Thu Sep 1 05:20:11 2022] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:11.315844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d840-05e8-4d5f-a3db-f15c0247bbbf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.316228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d840-05e8-4d5f-a3db-f15c0247bbbf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.316561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d840-05e8-4d5f-a3db-f15c0247bbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.323033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d064e-9352-4c66-b49e-c101a0fb0823 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:11.338269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d064e-9352-4c66-b49e-c101a0fb0823 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:11.344450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99df2f0-1686-4a64-bc64-4427fb343e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:11.345105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99df2f0-1686-4a64-bc64-4427fb343e3f service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.345376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99df2f0-1686-4a64-bc64-4427fb343e3f service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.345644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99df2f0-1686-4a64-bc64-4427fb343e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.354937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99df2f0-1686-4a64-bc64-4427fb343e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:11.356565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99df2f0-1686-4a64-bc64-4427fb343e3f service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:11.369892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 748/1517] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:20:11.383977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-69b4d840-05e8-4d5f-a3db-f15c0247bbbf None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:11.385248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-69b4d840-05e8-4d5f-a3db-f15c0247bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:11.483767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 770/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Sep 1 05:20:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:20.499806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd971-2979-4764-b9ce-d30b855e0561 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:20.500485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd971-2979-4764-b9ce-d30b855e0561 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:20.500485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edd971-2979-4764-b9ce-d30b855e0561 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:20.502120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 749/1519] 10.222.0.57 () {54 vars in 961 bytes} [Thu Sep 1 05:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:20.508549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cd591-fa93-4e7f-99b7-c7863aecb2b2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:20.509208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cd591-fa93-4e7f-99b7-c7863aecb2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:20.509208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cd591-fa93-4e7f-99b7-c7863aecb2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:20.530260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2b2cd591-fa93-4e7f-99b7-c7863aecb2b2 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:20.531542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2b2cd591-fa93-4e7f-99b7-c7863aecb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:20.540595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 771/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Sep 1 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:20.548950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd971-2979-4764-b9ce-d30b855e0561 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:20.564131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edd971-2979-4764-b9ce-d30b855e0561 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:20.569933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e9e81-533f-453a-aba4-167b6a5cbeef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:20.570560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e9e81-533f-453a-aba4-167b6a5cbeef service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:20.570835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e9e81-533f-453a-aba4-167b6a5cbeef service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:20.571104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e9e81-533f-453a-aba4-167b6a5cbeef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:20.580853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e9e81-533f-453a-aba4-167b6a5cbeef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:20.582620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e9e81-533f-453a-aba4-167b6a5cbeef service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:20.594092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 750/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:22.699575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598083-52cc-41f8-a2b7-b9a0a124dcc7 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.700218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598083-52cc-41f8-a2b7-b9a0a124dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.700402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598083-52cc-41f8-a2b7-b9a0a124dcc7 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.702513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:20:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:22.710427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a784-b75b-45e8-87de-96bbed2c69c2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.711328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a784-b75b-45e8-87de-96bbed2c69c2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.711328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a784-b75b-45e8-87de-96bbed2c69c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.733544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cf47a784-b75b-45e8-87de-96bbed2c69c2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:22.734829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cf47a784-b75b-45e8-87de-96bbed2c69c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:22.744297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:20:23.023490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598083-52cc-41f8-a2b7-b9a0a124dcc7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:23.042091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598083-52cc-41f8-a2b7-b9a0a124dcc7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:23.048157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84b2c-45e1-4838-8e10-91cd2885cc4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:23.048840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84b2c-45e1-4838-8e10-91cd2885cc4b service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:23.049118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84b2c-45e1-4838-8e10-91cd2885cc4b service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:23.049386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84b2c-45e1-4838-8e10-91cd2885cc4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:23.057362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:23.060930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c84b2c-45e1-4838-8e10-91cd2885cc4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:23.062983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c84b2c-45e1-4838-8e10-91cd2885cc4b service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:23.077031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 773/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:23.952746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc2395-a9c0-4d5a-860f-a7f8fea89e96 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:23.953357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc2395-a9c0-4d5a-860f-a7f8fea89e96 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:23.953357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc2395-a9c0-4d5a-860f-a7f8fea89e96 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:23.954624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:23.960522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc60a-505c-44c4-8790-a7373d88e793 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:23.961253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc60a-505c-44c4-8790-a7373d88e793 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:23.961253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dc60a-505c-44c4-8790-a7373d88e793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:23.982528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-601dc60a-505c-44c4-8790-a7373d88e793 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:23.983765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-601dc60a-505c-44c4-8790-a7373d88e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:23.992399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:20:24.149856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc2395-a9c0-4d5a-860f-a7f8fea89e96 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:24.166475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc2395-a9c0-4d5a-860f-a7f8fea89e96 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:24.172778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9425b-714e-4bc7-b7da-9cc85afcc3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:24.173423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9425b-714e-4bc7-b7da-9cc85afcc3f7 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:24.173708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9425b-714e-4bc7-b7da-9cc85afcc3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:24.173979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9425b-714e-4bc7-b7da-9cc85afcc3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:24.183737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9425b-714e-4bc7-b7da-9cc85afcc3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:24.185410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9425b-714e-4bc7-b7da-9cc85afcc3f7 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:24.196511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 753/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:28.183914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8a3f-8730-43ff-8534-b4f2c1956b0f None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:28.184538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8a3f-8730-43ff-8534-b4f2c1956b0f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:28.184538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c8a3f-8730-43ff-8534-b4f2c1956b0f None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:28.185933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:28.196220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a2d11-44c7-4dfe-9c3c-0440422785ab None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:28.196876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a2d11-44c7-4dfe-9c3c-0440422785ab None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:28.197231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a2d11-44c7-4dfe-9c3c-0440422785ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:28.223348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c58a2d11-44c7-4dfe-9c3c-0440422785ab None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:28.225551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c58a2d11-44c7-4dfe-9c3c-0440422785ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:28.234224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:28.535497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8a3f-8730-43ff-8534-b4f2c1956b0f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:28.538577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-632c8a3f-8730-43ff-8534-b4f2c1956b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:28.637682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c8a3f-8730-43ff-8534-b4f2c1956b0f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:28.643981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830ee19-30c6-4832-8dd6-83faef05c199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:28.645121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ee19-30c6-4832-8dd6-83faef05c199 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:28.645573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ee19-30c6-4832-8dd6-83faef05c199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:28.646084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ee19-30c6-4832-8dd6-83faef05c199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:28.663523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830ee19-30c6-4832-8dd6-83faef05c199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:28.666294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830ee19-30c6-4832-8dd6-83faef05c199 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:28.685125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 776/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:30.734241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958105db-abc2-406a-9a05-fb4bcc24cc40 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:30.734828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958105db-abc2-406a-9a05-fb4bcc24cc40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:30.734828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958105db-abc2-406a-9a05-fb4bcc24cc40 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:30.736399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:30.743026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4116e-8e07-4c44-9107-ed9974b1aa73 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:30.743623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4116e-8e07-4c44-9107-ed9974b1aa73 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:30.743743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4116e-8e07-4c44-9107-ed9974b1aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:30.772387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a9d4116e-8e07-4c44-9107-ed9974b1aa73 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:30.774458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a9d4116e-8e07-4c44-9107-ed9974b1aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:30.789335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:31.081333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958105db-abc2-406a-9a05-fb4bcc24cc40 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:31.087617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=52 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:31.095901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958105db-abc2-406a-9a05-fb4bcc24cc40 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:31.100241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91ea72-6ee8-4f53-a3fc-afd8984ccf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:31.100928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ea72-6ee8-4f53-a3fc-afd8984ccf86 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:31.101215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ea72-6ee8-4f53-a3fc-afd8984ccf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:31.101489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ea72-6ee8-4f53-a3fc-afd8984ccf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:31.111987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91ea72-6ee8-4f53-a3fc-afd8984ccf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:31.113488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91ea72-6ee8-4f53-a3fc-afd8984ccf86 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:31.124416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 756/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:35.024336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24cb39-aa4d-4595-99fd-d0dc98e2c47b None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:35.025013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24cb39-aa4d-4595-99fd-d0dc98e2c47b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:35.025013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24cb39-aa4d-4595-99fd-d0dc98e2c47b None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:35.026295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:35.033938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd4ff7-f871-45a2-bc6c-2b7f8b9861ac None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:35.034562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd4ff7-f871-45a2-bc6c-2b7f8b9861ac None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:35.034730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd4ff7-f871-45a2-bc6c-2b7f8b9861ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:35.058537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-33bd4ff7-f871-45a2-bc6c-2b7f8b9861ac None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:35.059904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-33bd4ff7-f871-45a2-bc6c-2b7f8b9861ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:35.069250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:35.671042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24cb39-aa4d-4595-99fd-d0dc98e2c47b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:35.673136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8d24cb39-aa4d-4595-99fd-d0dc98e2c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:35.743301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24cb39-aa4d-4595-99fd-d0dc98e2c47b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:35.747485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f06047-3294-410c-909a-6532fc3f961e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:35.748133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06047-3294-410c-909a-6532fc3f961e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:35.748405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06047-3294-410c-909a-6532fc3f961e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:35.748729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06047-3294-410c-909a-6532fc3f961e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:35.760330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f06047-3294-410c-909a-6532fc3f961e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:35.761942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f06047-3294-410c-909a-6532fc3f961e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:35.777593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 779/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:37.983054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76c2c-6dbd-4269-9933-864093358a39 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:37.983795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76c2c-6dbd-4269-9933-864093358a39 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:37.983795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76c2c-6dbd-4269-9933-864093358a39 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:37.985277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:37.992576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6779d-9057-43b8-a3ab-a4854c02c590 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:37.993244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6779d-9057-43b8-a3ab-a4854c02c590 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:37.993244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6779d-9057-43b8-a3ab-a4854c02c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:38.016879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-efa6779d-9057-43b8-a3ab-a4854c02c590 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:38.018166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-efa6779d-9057-43b8-a3ab-a4854c02c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:38.027155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:38.623513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad76c2c-6dbd-4269-9933-864093358a39 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:38.625939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4ad76c2c-6dbd-4269-9933-864093358a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:38.641369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad76c2c-6dbd-4269-9933-864093358a39 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:38.645593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fdc7e-5b06-4bd9-a714-fb6f044a1f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:38.646264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fdc7e-5b06-4bd9-a714-fb6f044a1f9f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:38.646580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fdc7e-5b06-4bd9-a714-fb6f044a1f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:38.646893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fdc7e-5b06-4bd9-a714-fb6f044a1f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:38.659187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fdc7e-5b06-4bd9-a714-fb6f044a1f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:38.661473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fdc7e-5b06-4bd9-a714-fb6f044a1f9f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:38.675822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 759/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:48.010843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=63 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:48.668641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=14 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:16.141873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.143258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.143731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.170356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:16.172223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:16.195443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 781/1540] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:16.205382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.206158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.206485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.284836 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:16.287016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:16.307438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 760/1541] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:16.312782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:16.331858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9da2a1-c134-4776-98e2-8b8ee8a0c9c6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:16.342706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:16.343374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.343658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.343929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.344655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:16.344969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:16.346125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:22:16.346125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:22:16.346125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:22:16.347145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:16.367679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 782/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:16.379113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:16.401132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1600ec-3e2b-4a08-8ea9-938534c7d165 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:16.416953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:16.418488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.418968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.419457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.420604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:16.422539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:22:16.422539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:22:16.422539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:22:16.426148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32da95-717c-4899-8c8f-efc30005dcd2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:16.517649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 761/1543] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:16.522008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:16.545850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977c19-e737-4823-b672-7328f7d4bcdc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:16.650714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:16.652156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.652697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.653213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.654099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:16.655388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:22:16.655388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:22:16.655388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:22:16.657137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:16.688274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf81e-9985-4114-98d6-1abd46bc0644 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.688848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf81e-9985-4114-98d6-1abd46bc0644 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.696011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 783/1544] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:16.697069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf81e-9985-4114-98d6-1abd46bc0644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.700667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:16.716513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad87e9-0c66-42ff-a344-92f72507ec83 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:16.728084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:16.729222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.729744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.730241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.731350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:16.733379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:16.751796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 784/1545] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:22:16.758136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:16.771663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-630bf81e-9985-4114-98d6-1abd46bc0644 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:16.774054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c5d22-b8f6-462a-bd4f-065786c907c7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:16.774302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-630bf81e-9985-4114-98d6-1abd46bc0644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:16.799094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bafad5-be5f-49ab-8265-d0e58ca68e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:16.800328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafad5-be5f-49ab-8265-d0e58ca68e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.800855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafad5-be5f-49ab-8265-d0e58ca68e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.801499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bafad5-be5f-49ab-8265-d0e58ca68e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.802443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafad5-be5f-49ab-8265-d0e58ca68e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:16.804466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bafad5-be5f-49ab-8265-d0e58ca68e2a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:16.812915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 762/1546] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:16.815906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.816506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.817178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.831314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 785/1547] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:16.840653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddd767-1fce-47bd-8108-4af033a9c4f6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.841681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddd767-1fce-47bd-8108-4af033a9c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.842174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddd767-1fce-47bd-8108-4af033a9c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.876194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2cddd767-1fce-47bd-8108-4af033a9c4f6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:16.877904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2cddd767-1fce-47bd-8108-4af033a9c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:16.879382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:16.883818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:16.897206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 786/1548] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:16.899329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd307-9c2a-4fd9-9503-5bcaa027a305 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.900660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd307-9c2a-4fd9-9503-5bcaa027a305 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.902977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbd307-9c2a-4fd9-9503-5bcaa027a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.903914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 763/1549] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:16.905086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:16.931451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bcaef-b65e-469c-9637-58c34968e5bb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:16.958639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:16.959773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:16.960243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:16.960757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] PATH_INFO: `/v3/projects/710d5b0e08ff4597bf4b6d11a43a6ca2/users/3d27e93db5ec41e29196e6ff64608b96/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:16.963920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-94bbd307-9c2a-4fd9-9503-5bcaa027a305 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:16.969731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-94bbd307-9c2a-4fd9-9503-5bcaa027a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.002411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 787/1550] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.004790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943ea7-f085-4fd8-a33c-86c22fdcb00e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.005272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943ea7-f085-4fd8-a33c-86c22fdcb00e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.005735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943ea7-f085-4fd8-a33c-86c22fdcb00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.017608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710d5b0e08ff4597bf4b6d11a43a6ca2, user_id=3d27e93db5ec41e29196e6ff64608b96, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.019975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:22:17.019975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:22:17.019975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:22:17.023947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f570e-a3fd-4f28-8b4e-c615bc20df38 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.031554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-16943ea7-f085-4fd8-a33c-86c22fdcb00e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.032854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-16943ea7-f085-4fd8-a33c-86c22fdcb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.048567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 788/1551] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.050861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.051146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.051423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.054523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 764/1552] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:16 2022] PUT /identity/v3/projects/710d5b0e08ff4597bf4b6d11a43a6ca2/users/3d27e93db5ec41e29196e6ff64608b96/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:17.056279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94ffb3-213d-4efc-a498-b32e25448a70 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.056866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94ffb3-213d-4efc-a498-b32e25448a70 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.057384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94ffb3-213d-4efc-a498-b32e25448a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.078257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.079475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.081649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-da94ffb3-213d-4efc-a498-b32e25448a70 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.082960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-da94ffb3-213d-4efc-a498-b32e25448a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.166220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 789/1553] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.167305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.175927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 765/1554] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.175927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba11f31-2a1c-43ee-9668-cfb6c989a2af None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.175927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba11f31-2a1c-43ee-9668-cfb6c989a2af None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.175927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba11f31-2a1c-43ee-9668-cfb6c989a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.184993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7854-1883-4128-9dd1-10044c6bf953 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.191155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.191958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.192358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.192829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.193803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:17.194287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.196199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637223d-d31b-4a8e-b0fb-5b78d2f3b4ba admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.197835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8ba11f31-2a1c-43ee-9668-cfb6c989a2af None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.199292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8ba11f31-2a1c-43ee-9668-cfb6c989a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.209057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 766/1555] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.221789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 790/1556] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:17.222255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562c45-cd46-4d71-8679-cee875380c43 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.222255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562c45-cd46-4d71-8679-cee875380c43 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.222578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.222755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562c45-cd46-4d71-8679-cee875380c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.222915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.222915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.246283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-de562c45-cd46-4d71-8679-cee875380c43 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.247575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-de562c45-cd46-4d71-8679-cee875380c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.251706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.253676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.257214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 767/1557] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.261079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.261079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.261079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.271626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 791/1558] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.273122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.290835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71fa8-ca08-4495-841f-31e97dc6e3ba None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.292339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.293755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.298402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.299504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.300048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.300472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.301623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:17.302132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.305138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c7aa5-99fe-4135-a1ac-0fe5f7b0c788 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.309077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 768/1559] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.311441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:17.312546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.329633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 792/1560] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:17.332194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0b900-f8b1-4315-a84c-1adaf9b8e6f3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.332684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0b900-f8b1-4315-a84c-1adaf9b8e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.333495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0b900-f8b1-4315-a84c-1adaf9b8e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.340295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223f0f6-7b57-42d3-aafc-753869ce849f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.350873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.352535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.353308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.353951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.355341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:17.356204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.360727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.368108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-06c0b900-f8b1-4315-a84c-1adaf9b8e6f3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.369848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-06c0b900-f8b1-4315-a84c-1adaf9b8e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.395910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 769/1561] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:17.396230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 793/1562] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.396230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.396230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.396230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.397995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.416780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522948c2-1c33-4035-98fd-c471b342a553 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.423569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.424417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.424951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.425364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.426162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.428249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:17.428471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.430343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:17.444696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 794/1563] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:17.445858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.482042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 770/1564] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:17.482042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.561674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:17.569714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6a466-cf3e-469e-8045-9497e6144ed9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.601086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09947d14-7ec2-4dcc-a616-9c4239059ee0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.609251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.610289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.610787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.611217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.612434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:17.612991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.616202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.644668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 771/1565] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:17.644668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.668079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15aca-f9c0-44e9-ab4f-531953952e82 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.675847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.676961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.677431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.677916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.679029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.682531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.682739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.683275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.683634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.683965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.694929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.696426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.708266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 795/1566] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:17.709202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.724163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d7753-3717-4b76-ac50-638a79f3db58 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.727026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 772/1567] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:17.728086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.832412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b9bc2-fb89-4f93-afac-7d7044af43e9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.840539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.841883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.842437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.843916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.845312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.846988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:17.847563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.848034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:17.848560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:17.849164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:17.850847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:17.851310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:17.855160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:17.891539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 796/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:17.891845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 773/1569] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:17.892014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.892172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:17.903675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827422-aa9d-4254-bb70-e640d2309dec admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:17.962259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:18.009720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b416b0-5ba6-48c1-9b06-6239b5c4ddcd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.012692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.013394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.013716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.013915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.014681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:18.014989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.016725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.019248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2956d-d413-40df-baeb-fab3235574cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.020745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2956d-d413-40df-baeb-fab3235574cc admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.021277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2956d-d413-40df-baeb-fab3235574cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.021837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2956d-d413-40df-baeb-fab3235574cc admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.023102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2956d-d413-40df-baeb-fab3235574cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.027055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2956d-d413-40df-baeb-fab3235574cc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.032193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 797/1570] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:18.033115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.048983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486c6e-f820-46f9-ad91-0604ec8f25ff admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.060325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.061467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.061997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.062539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.063516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.066687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.074720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 774/1571] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:17 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.077285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.077751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.078295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.113456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:18.115647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:18.128609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 798/1572] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.131205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.137287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 775/1573] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:18.139388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.159478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddf14c-184c-4630-a7b8-a4f553924d07 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.187254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:18.230067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffffce6-6fcd-497a-9bf6-4ea523ce736f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.237233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.237629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.237916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.238192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.238931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.241119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.266818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.267862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.268246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.268778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.269975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.271418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 799/1574] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.272292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.276251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.285141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfb268-3c9a-48d6-9ca4-b2d79ae76b03 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.291635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.292276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.292552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.292861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.294198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.296520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.329873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 800/1575] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/users => generated 302 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.331032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.339301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 776/1576] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.339301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.346665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ceb36-6290-4c44-bf0d-5c6fac0efd0b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.500561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227fed0-0fff-451b-8b9f-b005a04aca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.503291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227fed0-0fff-451b-8b9f-b005a04aca18 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.503291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227fed0-0fff-451b-8b9f-b005a04aca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.503291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227fed0-0fff-451b-8b9f-b005a04aca18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.505522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227fed0-0fff-451b-8b9f-b005a04aca18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.511537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227fed0-0fff-451b-8b9f-b005a04aca18 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.516987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75284b-96a4-4eee-a692-829187888a99 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.529813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.530994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.531625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.532178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.533438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.536681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.556756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 777/1577] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.558807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.565205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 801/1578] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.567350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.568090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.569094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.579229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbcf8-cd1b-4b72-a448-1876cc6316df admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.586231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:18.607428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:18.609531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:18.681342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.682667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.682990 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.683441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.684571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.688494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.698534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 802/1579] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:18.703167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.717993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782e52-4b0a-4214-930b-f6255431eca7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.727663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.728306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.728901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.729035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 778/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.729667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.730400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.732092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.732761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.743971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587f78-6018-4bc1-a68d-807edcfd37cc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.744705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 803/1581] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.745653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.753063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.753741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.754027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.754988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.755770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.758320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.758612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ee286-557a-4849-b2a1-dd7f7203f852 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.763993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.764658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.764942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.765213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.765875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.768227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.774075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 779/1582] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.775541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.791110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93762-42f8-4005-a1bd-1b77cba9d0f9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.796330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 804/1583] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/users => generated 285 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.797268 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.798067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.798201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.798412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.798694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.799401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.801323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.814285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b052a2-c70a-48e9-a23a-89c4dd0ed614 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.821503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.822291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.822486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 780/1584] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.822641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.823000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.823829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.824041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.826270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.837549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8f82d-f625-41e8-9dc9-6353e5c0f1bf admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.844110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.846226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.847528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.847528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.847815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:18.848075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.850902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.855401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:18.872518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 805/1585] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:18 2022] POST /identity/v3/users => generated 297 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:18.873797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.875269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 781/1586] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:18.876529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.886132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07638-a547-4de1-8204-e9e4e7f0cbe5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.892447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5650962-aeed-403f-be79-4627cec8bce1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.893388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.894252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.894803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.895342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.896251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.898735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.900065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.900919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.901217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.901703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.903043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.905194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.914882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 806/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.921844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.926895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 782/1588] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.932243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.947157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347b856-e58a-4095-a5e5-41f3ac0c350d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.952967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.953674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c23489-e6ac-404e-a1c2-90fe78a704e4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:18.953899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.954288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.954672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.955635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.957810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.963362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:18.964863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:18.965355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:18.966445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:18.967747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:18.971921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:18.976727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 783/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.978307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.990283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 807/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:18.991216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:18.999787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c1f3-ba7e-43df-aed7-8f12dfea0aee admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.006823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e165f2-bb9f-41dd-bb94-748fd231dae3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.009579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.010655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.011162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.011615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] PATH_INFO: `/v3/projects/b05cbfc12aff4ddfa7607905aa7722e4/users/b80cf63a5f10485aa4a3869fa60d2300/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.014415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.015103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.015382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.015899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.016676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.018679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.041904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 808/1591] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:19.044769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.046355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05cbfc12aff4ddfa7607905aa7722e4, user_id=b80cf63a5f10485aa4a3869fa60d2300, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.051317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.066889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afac3f-bab1-40d1-8822-b1635041f1b6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.083311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 784/1592] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:18 2022] PUT /identity/v3/projects/b05cbfc12aff4ddfa7607905aa7722e4/users/b80cf63a5f10485aa4a3869fa60d2300/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:19.085122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.189748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1cb4-224a-4ade-8cf7-93bfe7be595d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.193770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.194630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.195016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.195469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.196291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.196534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.198121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.198121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.198121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.199220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.201729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.207089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.235553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 785/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:19.238225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.244846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 809/1594] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:19 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:19.245930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.262233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f222f-10c3-4ef9-8270-6f5e29bb0e98 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.271962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:19.360743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175cd6-3d82-4a3c-8385-69a252762c9f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.368470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.369161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.369436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.370241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.370932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.373387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.380303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.382450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.383142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.383811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] PATH_INFO: `/v3/projects/28e74919cf5c4de5813d9b77cb1560ff/users/de343953c3f24a4fbf8277edb098f165/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.391214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 810/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:19.391214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.404054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f57d7-3d2f-4906-b1a6-fd4a47846773 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.412545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e74919cf5c4de5813d9b77cb1560ff, user_id=de343953c3f24a4fbf8277edb098f165, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.413854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea045ada-70a4-4239-a1a6-889f9cbfca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.414753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea045ada-70a4-4239-a1a6-889f9cbfca8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.415106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea045ada-70a4-4239-a1a6-889f9cbfca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.415485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea045ada-70a4-4239-a1a6-889f9cbfca8f admin admin] PATH_INFO: `/v3/projects/5054b514677741759536c3cdaf2335cc/users/0d362d78fa6c4e37aa3815f4bca27208/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.415709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.440610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea045ada-70a4-4239-a1a6-889f9cbfca8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5054b514677741759536c3cdaf2335cc, user_id=0d362d78fa6c4e37aa3815f4bca27208, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.447255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 786/1596] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:19 2022] PUT /identity/v3/projects/28e74919cf5c4de5813d9b77cb1560ff/users/de343953c3f24a4fbf8277edb098f165/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:19.447255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.447693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea045ada-70a4-4239-a1a6-889f9cbfca8f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.470414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 811/1597] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:19 2022] PUT /identity/v3/projects/5054b514677741759536c3cdaf2335cc/users/0d362d78fa6c4e37aa3815f4bca27208/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:19.473990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.473990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.474760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.513056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:19.514325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:19.526196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:19.602991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 812/1598] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:19.608335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.609195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a761804-a1ea-41d9-83c9-d58b027d1cd1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.620042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.621709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.622409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.622600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63b17-7224-410c-a3b5-93f40869ceae None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.623257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.625273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.629833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.630624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.630966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.631311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] PATH_INFO: `/v3/projects/3d706052c3924cf88b9ea5b24b26403b/users/8c8ad3919d764781a90420e48c65df2c/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.632344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.654396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d706052c3924cf88b9ea5b24b26403b, user_id=8c8ad3919d764781a90420e48c65df2c, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.657257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.673368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 787/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:19.675665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.681893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 813/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:19 2022] PUT /identity/v3/projects/3d706052c3924cf88b9ea5b24b26403b/users/8c8ad3919d764781a90420e48c65df2c/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:19.682882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:19.704366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01e206-1b76-4b93-938d-5e019aadfb32 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.781008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259c2d-2de8-4be1-a5d7-d0ff6e9a196b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:19.788369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20fd7d-ed8a-44b6-868d-3a426bc15081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.789557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fd7d-ed8a-44b6-868d-3a426bc15081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.789942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fd7d-ed8a-44b6-868d-3a426bc15081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.790194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fd7d-ed8a-44b6-868d-3a426bc15081 admin admin] PATH_INFO: `/v3/projects/4f10cfcb354747f38cfd1128ae4f5a4b/users/537c504172af4d248000996b4ba39aa4/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.793425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:19.818396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20fd7d-ed8a-44b6-868d-3a426bc15081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f10cfcb354747f38cfd1128ae4f5a4b, user_id=537c504172af4d248000996b4ba39aa4, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.822522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20fd7d-ed8a-44b6-868d-3a426bc15081 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.846326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 814/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:19 2022] PUT /identity/v3/projects/4f10cfcb354747f38cfd1128ae4f5a4b/users/537c504172af4d248000996b4ba39aa4/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:19.849309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.849559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.849959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.865026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01641-11bf-47de-b1be-4f4d4ebca75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:19.873573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01641-11bf-47de-b1be-4f4d4ebca75e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.874256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01641-11bf-47de-b1be-4f4d4ebca75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.874404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01641-11bf-47de-b1be-4f4d4ebca75e admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:19.879035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01641-11bf-47de-b1be-4f4d4ebca75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:19.882899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01641-11bf-47de-b1be-4f4d4ebca75e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:19.887236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:19.889564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:19.934400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 788/1602] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:19 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:19.937923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:19.938793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:19.939557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.045172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] MFA Rules not processed for user `0d362d78fa6c4e37aa3815f4bca27208`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:20.046806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 815/1603] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:20.047667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:20.047855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.168511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b13b9-530e-4c33-be05-1681c399bac7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.174307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ab486-2764-4e78-91f9-63c7b8b11b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.175408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ab486-2764-4e78-91f9-63c7b8b11b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.175882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ab486-2764-4e78-91f9-63c7b8b11b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.176339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ab486-2764-4e78-91f9-63c7b8b11b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.177394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 789/1604] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:20.178292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.191445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45066fa0-8e7f-4c88-8db7-9e84920a46fa None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.197173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbe5e7-a9f9-464f-aeab-57be1333e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.198543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbe5e7-a9f9-464f-aeab-57be1333e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.198824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbe5e7-a9f9-464f-aeab-57be1333e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.199094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbe5e7-a9f9-464f-aeab-57be1333e315 admin admin] PATH_INFO: `/v3/projects/1447b14ed43f44508789a67b5d1f7b5f/users/c53e53ea051c4594b6c84f4ae58ac43f/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.200787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ab486-2764-4e78-91f9-63c7b8b11b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.202961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ab486-2764-4e78-91f9-63c7b8b11b83 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.223349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 816/1605] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:20.224647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbe5e7-a9f9-464f-aeab-57be1333e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1447b14ed43f44508789a67b5d1f7b5f, user_id=c53e53ea051c4594b6c84f4ae58ac43f, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.225887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.226511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.227079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.230082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbe5e7-a9f9-464f-aeab-57be1333e315 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.254954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 790/1606] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:20 2022] PUT /identity/v3/projects/1447b14ed43f44508789a67b5d1f7b5f/users/c53e53ea051c4594b6c84f4ae58ac43f/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:20.258506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.259165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.259828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.261834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:20.270440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:20.353751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] MFA Rules not processed for user `537c504172af4d248000996b4ba39aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:20.353751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:20.379488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:20.441358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 817/1607] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:20.441358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.450823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbdd71-0b50-4ecd-b0f8-38d30496bdbd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.459243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.459912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.460189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.460462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.461174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.462891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.476892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 818/1608] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:20.477831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.481910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:20.518867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 791/1609] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:20.520379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.523966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:20.541149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5e17d-6b2e-4f2b-a328-89e4606f35cc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.550619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9a2a-cc65-4258-8005-f80b82122001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.552248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9a2a-cc65-4258-8005-f80b82122001 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.552912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9a2a-cc65-4258-8005-f80b82122001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.553503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9a2a-cc65-4258-8005-f80b82122001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.555087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9a2a-cc65-4258-8005-f80b82122001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.560660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9a2a-cc65-4258-8005-f80b82122001 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.595631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91fa84-e5fc-4fba-bd88-d1b670d74bb4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.601607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.602438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.602667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.603096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.619243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.622345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.625991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 792/1610] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:20 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:20.629617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.630386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.631020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.641589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 819/1611] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:20.643590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.656988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f002ee-3047-4040-8e9e-92705846ccbc service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.662917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:20.665437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:20.787404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.789096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.789580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.790556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.848928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 793/1612] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:20.851154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.876074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329c86-304e-4f59-8a37-08cbd6af5120 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.886495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.887583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.888001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.888400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.891150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.895432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.931116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 794/1613] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:20.932063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:20.956472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35564638-5528-4135-8c64-12a23a3f4015 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:20.959122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.965383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:20.966562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:20.967104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:20.967657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:20.969027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:20.973421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.977157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:20.995030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 820/1614] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:20.997488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.053615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752a20-4574-429f-a207-2b1f95390db6 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.076775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 795/1615] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:20 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:21.077533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.085774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.086786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.087204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.087463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.088318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.095463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:21.186308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 821/1616] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:20 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:21.189208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.224478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618f1c-8e56-4ae9-abaf-ee5be5acaa40 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.248742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c81c3a-2e3b-4b3f-9c62-54880ff01b16 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.263268 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.270767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.271755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.273855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.307779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:21.429738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:21.497547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.499939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.501019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.501780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] PATH_INFO: `/v3/projects/cbf45d937ab949b28ada715ce874340b/users/e6f1993f3d634c6b8fa4e89ce33dc2f7/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.536833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.539849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:21.570919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf45d937ab949b28ada715ce874340b, user_id=e6f1993f3d634c6b8fa4e89ce33dc2f7, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.577492 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:21.592851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 796/1617] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:21.594352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.627801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1c3d-3a9e-4af8-ac03-9fbb8fa1a6f1 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.633394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 822/1618] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:21 2022] PUT /identity/v3/projects/cbf45d937ab949b28ada715ce874340b/users/e6f1993f3d634c6b8fa4e89ce33dc2f7/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:21.635758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.780210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694b9c-f880-4261-b276-689daa0ef752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.781825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694b9c-f880-4261-b276-689daa0ef752 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.782318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694b9c-f880-4261-b276-689daa0ef752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.782801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694b9c-f880-4261-b276-689daa0ef752 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.784239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694b9c-f880-4261-b276-689daa0ef752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.789283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694b9c-f880-4261-b276-689daa0ef752 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:21.820098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747d6e-89df-4fd9-9c4c-671e1cf12615 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.826183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.827100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.827610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.827989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.829233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.831543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:21.839829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 797/1619] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:21 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:21.841853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.842329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.842795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.850897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 823/1620] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:21.850897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.872171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280858a9-c70f-40c4-bbb3-74880bfc44ff admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.889173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.891930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.892860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.894350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.897500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.898493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:21.912836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 824/1621] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:21.913845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:21.915215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] MFA Rules not processed for user `e6f1993f3d634c6b8fa4e89ce33dc2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:21.921176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:21.942127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3492b7-aabb-49ff-9dd3-822dc137aea1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:21.956177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:21.958688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:21.959476 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:21.960131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] PATH_INFO: `/v3/projects/7849d435f381471ab5ee90c891621fd5/users/22a78e81b4a34aae828b930a4ea49b87/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:21.989505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7849d435f381471ab5ee90c891621fd5, user_id=22a78e81b4a34aae828b930a4ea49b87, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:21.992929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:22.022862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 825/1622] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:21 2022] PUT /identity/v3/projects/7849d435f381471ab5ee90c891621fd5/users/22a78e81b4a34aae828b930a4ea49b87/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:22.024855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.121804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 798/1623] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:22.125541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.157261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ef2d9-08df-4790-93d5-66e8a10d441a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:22.226210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69a549-66a7-48f5-b9d7-d9ee1ea8872e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:22.238826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:22.244190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:22.247209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:22.247761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:22.249553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] PATH_INFO: `/v3/projects/75df34ac1ba04a6086b470367f794530/users/a97002dad8f54375b3e828f3f3461d8b/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:22.303033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75df34ac1ba04a6086b470367f794530, user_id=a97002dad8f54375b3e828f3f3461d8b, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:22.312696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:22.351183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 826/1624] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:22 2022] PUT /identity/v3/projects/75df34ac1ba04a6086b470367f794530/users/a97002dad8f54375b3e828f3f3461d8b/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:22.351183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.366520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:22.367733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:22.368018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:22.369644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:22.372616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:22.375111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:22.409182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 799/1625] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:22.410502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:22.411996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.440638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5efeb-be08-4e55-8e83-61f65ff5fb0f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:22.543629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a821-05fb-4714-819e-f68f47399f53 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:22.556069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:22.556763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:22.557039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:22.557294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:22.563202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:22.565523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:22.621772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:22.622694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:22.628442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:22.629625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:22.630927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:22.636826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:22.645315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 827/1626] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:22 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:22.647477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.680465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 800/1627] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:22.682188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.720304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974126b-ab54-48bd-a710-cee120941d36 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:22.833953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dd5f9-899f-4c42-bc44-083a0147b8c6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:22.842121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:22.842978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:22.843382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:22.843867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] PATH_INFO: `/v3/projects/7849d435f381471ab5ee90c891621fd5/users/22a78e81b4a34aae828b930a4ea49b87/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:22.847464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7849d435f381471ab5ee90c891621fd5, user_id=22a78e81b4a34aae828b930a4ea49b87, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:22.853119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:22.875033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 828/1628] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:22 2022] PUT /identity/v3/projects/7849d435f381471ab5ee90c891621fd5/users/22a78e81b4a34aae828b930a4ea49b87/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:22.876080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:22.979172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00da0-952b-41ab-b38a-5f204515bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:22.980135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00da0-952b-41ab-b38a-5f204515bab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:22.980539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00da0-952b-41ab-b38a-5f204515bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:22.980986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00da0-952b-41ab-b38a-5f204515bab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:22.982017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b00da0-952b-41ab-b38a-5f204515bab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:22.985550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b00da0-952b-41ab-b38a-5f204515bab3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:23.063819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 801/1629] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:22 2022] POST /identity/v3/users => generated 295 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:23.067768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffba87-a02b-41eb-ac16-0a8e2ab25785 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:23.068314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffba87-a02b-41eb-ac16-0a8e2ab25785 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:23.068844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffba87-a02b-41eb-ac16-0a8e2ab25785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:23.182403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-08ffba87-a02b-41eb-ac16-0a8e2ab25785 None None] MFA Rules not processed for user `22a78e81b4a34aae828b930a4ea49b87`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:23.184745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-08ffba87-a02b-41eb-ac16-0a8e2ab25785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:23.191163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16dd5b-66fe-4285-a84e-45ce518923d9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:23.213935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:23.215685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:23.216651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:23.217654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] PATH_INFO: `/v3/projects/75df34ac1ba04a6086b470367f794530/users/a97002dad8f54375b3e828f3f3461d8b/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:23.230393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75df34ac1ba04a6086b470367f794530, user_id=a97002dad8f54375b3e828f3f3461d8b, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:23.242149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:23.293921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 829/1630] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:22 2022] PUT /identity/v3/projects/75df34ac1ba04a6086b470367f794530/users/a97002dad8f54375b3e828f3f3461d8b/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:23.298068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:23.317610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:23.413294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 802/1631] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:23.414776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:23.415057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:23.415332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:23.466213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:23.519011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] MFA Rules not processed for user `a97002dad8f54375b3e828f3f3461d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:23.520375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:23.577783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8950-58ca-411e-a80f-48d71bfe5d82 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:23.592796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:23.593670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:23.594082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:23.594420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:23.595596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:23.599149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:23.635271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 830/1632] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:23.636203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:23.776356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 803/1633] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:23.776356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:23.804529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80afea-2b31-44ea-97be-e0adf488185f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:23.810133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47051fe9-48db-448c-ad09-3baee2e2e7f6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:23.817590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:23.818288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:23.818564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:23.818899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:23.827904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:23.828784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:23.829125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:23.830544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] PATH_INFO: `/v3/projects/4a63b5057ab84c908dec1bc28eeff9cc/users/a758209bf6884184b03736d3e630a14a/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:23.871001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a63b5057ab84c908dec1bc28eeff9cc, user_id=a758209bf6884184b03736d3e630a14a, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:23.874368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:23.927039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 804/1634] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:23 2022] PUT /identity/v3/projects/4a63b5057ab84c908dec1bc28eeff9cc/users/a758209bf6884184b03736d3e630a14a/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:23.928385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:24.026348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:24.031496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:24.067887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 831/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:23 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:24.069160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:24.098339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0f1a2-6b8f-4a85-885a-090dc87e938a service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:24.223482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da88c4-f237-41c6-a3c7-89738a489611 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:24.249233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:24.250474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:24.251221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:24.251820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:24.273598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:24.274545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:24.274545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:24.312384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:24.312384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:24.312384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:24.332806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 832/1636] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:24.353234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:24.373792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4ab1-fadd-4583-b713-ce8c1e566892 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:24.390142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2938d5-3f50-419d-9584-32401b881040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:24.390885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2938d5-3f50-419d-9584-32401b881040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:24.391397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2938d5-3f50-419d-9584-32401b881040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:24.391698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2938d5-3f50-419d-9584-32401b881040 admin admin] PATH_INFO: `/v3/projects/4a63b5057ab84c908dec1bc28eeff9cc/users/a758209bf6884184b03736d3e630a14a/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:24.399345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2938d5-3f50-419d-9584-32401b881040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a63b5057ab84c908dec1bc28eeff9cc, user_id=a758209bf6884184b03736d3e630a14a, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:24.402870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2938d5-3f50-419d-9584-32401b881040 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:24.421882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:24.439418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 833/1637] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:24 2022] PUT /identity/v3/projects/4a63b5057ab84c908dec1bc28eeff9cc/users/a758209bf6884184b03736d3e630a14a/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:24.465138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:24.465423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:24.465697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:24.485864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:24.529280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:24.531615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:24.555124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] MFA Rules not processed for user `a758209bf6884184b03736d3e630a14a`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:24.559108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:24.573715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 805/1638] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:24.609688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:24.628221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30644722-e5fb-4d20-96d2-03ad5c05aa5f service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:24.771254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 834/1639] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:24.793086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:24.811545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:24.812613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:24.813101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:24.813590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] PATH_INFO: `/v3/users/0d362d78fa6c4e37aa3815f4bca27208` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:24.816325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d362d78fa6c4e37aa3815f4bca27208)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:24.818262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: WARNING py.warnings [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:22:24.818262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: warnings.warn(msg) Sep 01 05:22:24.818262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: Sep 01 05:22:24.822714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:24.963756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7b09d-b876-48d7-9643-e20f942b79be None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:24.986441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:24.993371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:24.997420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:24.998463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:25.077705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d362d78fa6c4e37aa3815f4bca27208'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:25.097867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d362d78fa6c4e37aa3815f4bca27208'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:25.099189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d362d78fa6c4e37aa3815f4bca27208'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:25.162200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d362d78fa6c4e37aa3815f4bca27208'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:25.184658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d426e19d-79a9-41f9-91bd-3567a2ab6ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d362d78fa6c4e37aa3815f4bca27208'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:25.197593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 806/1640] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:24 2022] DELETE /identity/v3/users/0d362d78fa6c4e37aa3815f4bca27208 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:25.202656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:25.203214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:25.203671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:25.204413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:25.206671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:25.233029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:25.235654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:25.239108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 835/1641] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:25.472170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 807/1642] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:25.529629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:25.637118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:25.675694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1f65-5c8f-4aa9-841e-e9482459ef55 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:25.865294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:25.866014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:25.866463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:25.867076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:25.901172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:25.904486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:25.921970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 836/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:28.817147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:28.819723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:28.823465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:28.825145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:28.840433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84805ef7-1b45-4e15-9311-9f3ac9a7f113 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:28.847752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:28.848797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:28.849249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:28.849668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] PATH_INFO: `/v3/projects/5054b514677741759536c3cdaf2335cc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:28.851145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5054b514677741759536c3cdaf2335cc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:28.852369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: WARNING py.warnings [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:22:28.852369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: warnings.warn(msg) Sep 01 05:22:28.852369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: Sep 01 05:22:28.856452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:28.910270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:28.963465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5d12-ddff-43c3-b940-3a8b6093fb99 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:28.974873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5054b514677741759536c3cdaf2335cc', 'request_id': 'req-a0a2d432-688a-4448-aca9-a6515dc5bdba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.010760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5054b514677741759536c3cdaf2335cc', 'request_id': 'req-a0a2d432-688a-4448-aca9-a6515dc5bdba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.031473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5054b514677741759536c3cdaf2335cc', 'request_id': 'req-a0a2d432-688a-4448-aca9-a6515dc5bdba'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.083525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] The token cache is being invalidate because project 5054b514677741759536c3cdaf2335cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:29.083928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.087494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.099152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 837/1644] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:28 2022] DELETE /identity/v3/projects/5054b514677741759536c3cdaf2335cc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:29.100808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:29.102080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:29.114495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:29.115270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:29.115543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:29.115818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] PATH_INFO: `/v3/users/537c504172af4d248000996b4ba39aa4` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:29.117065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537c504172af4d248000996b4ba39aa4)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:29.125551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:29.181462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d432-688a-4448-aca9-a6515dc5bdba admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:29.186692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:29.187472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:29.187818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:29.188163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] PATH_INFO: `/v3/users/22a78e81b4a34aae828b930a4ea49b87` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:29.189561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a78e81b4a34aae828b930a4ea49b87)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:29.191661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:29.228171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:29.266190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537c504172af4d248000996b4ba39aa4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.285325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537c504172af4d248000996b4ba39aa4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.286025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537c504172af4d248000996b4ba39aa4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.316443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537c504172af4d248000996b4ba39aa4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.323834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a78e81b4a34aae828b930a4ea49b87'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.326150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a78e81b4a34aae828b930a4ea49b87'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.326382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b7cacb0a-1b24-4fd1-99d0-51f378417931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537c504172af4d248000996b4ba39aa4'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.345125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 808/1645] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:28 2022] DELETE /identity/v3/users/537c504172af4d248000996b4ba39aa4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:29.348245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d428971-b047-4c4c-90a2-2fc89ebbf1f6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:29.348508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d428971-b047-4c4c-90a2-2fc89ebbf1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:29.348871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d428971-b047-4c4c-90a2-2fc89ebbf1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:29.351281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a78e81b4a34aae828b930a4ea49b87'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.388264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a78e81b4a34aae828b930a4ea49b87'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.398799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1d428971-b047-4c4c-90a2-2fc89ebbf1f6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:29.400062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d428971-b047-4c4c-90a2-2fc89ebbf1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:29.412972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a78e81b4a34aae828b930a4ea49b87'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:29.437382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 838/1646] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:29 2022] DELETE /identity/v3/users/22a78e81b4a34aae828b930a4ea49b87 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:29.567712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 809/1647] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:29.746715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:29.749390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:29.849433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf9e47-f8ed-4e54-ad69-e6ec3e045113 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:29.855461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:29.856198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:29.856484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:29.857018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:30.075132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:30.077229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:30.101825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 839/1648] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:31.421125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:31.422609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:31.427713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:31.432704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:31.433287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:31.556101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b02e2-c07d-4d77-a8aa-62231f7ea0aa service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:31.572136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:31.572675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:31.572958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:31.573310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:31.575520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:31.583573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:31.587993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] MFA Rules not processed for user `3d27e93db5ec41e29196e6ff64608b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:31.597611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:31.619722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:31.777980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:31.785222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2e064-2747-4b5a-bf3b-ae298b47b7e2 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:31.813548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 810/1649] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:31.814591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:31.818208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:31.826071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 840/1650] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:22:31.853360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88053a62-3d46-43fc-9011-21b7f27f07bb None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:31.865862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:31.866536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:31.866812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:31.867075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] PATH_INFO: `/v3/projects/7849d435f381471ab5ee90c891621fd5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:31.868279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7849d435f381471ab5ee90c891621fd5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:31.880397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:31.895083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fd8b5-cf67-45f0-83dc-a8f9958c7abf None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:31.895273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fd8b5-cf67-45f0-83dc-a8f9958c7abf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:31.896154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fd8b5-cf67-45f0-83dc-a8f9958c7abf None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:31.897555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 841/1651] 10.222.0.57 () {54 vars in 962 bytes} [Thu Sep 1 05:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:22:31.930861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:31.931226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:31.931551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:32.041071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7849d435f381471ab5ee90c891621fd5', 'request_id': 'req-78473cd2-e232-4b47-8b8b-90b618ad2982'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:32.079657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:32.081422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:32.108480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7849d435f381471ab5ee90c891621fd5', 'request_id': 'req-78473cd2-e232-4b47-8b8b-90b618ad2982'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:32.153087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7849d435f381471ab5ee90c891621fd5', 'request_id': 'req-78473cd2-e232-4b47-8b8b-90b618ad2982'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:32.238247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] The token cache is being invalidate because project 7849d435f381471ab5ee90c891621fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:32.241691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:32.245825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-78473cd2-e232-4b47-8b8b-90b618ad2982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:32.285107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 811/1652] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:31 2022] DELETE /identity/v3/projects/7849d435f381471ab5ee90c891621fd5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:32.290188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:32.290475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:32.290749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:32.353953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 842/1653] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Sep 1 05:22:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:32.363016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:32.368563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:32.371385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:32.401829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4f474-ce89-4154-a3ef-2b9d3ffe6fac None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:32.422235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:32.424981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:32.425289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:32.425557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:32.429529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:32.637186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:32.641307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8077389-5b93-4004-a507-968a1bb547fe service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:32.668724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 843/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:32.780916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 812/1655] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:32.782851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:32.784749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:32.785600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:32.866844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:32.872446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:32.927923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 844/1656] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:32.932768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:32.950327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e0b9-b81c-4bbe-ad50-5d0396df598f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:32.969961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:32.977487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:32.981631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:32.982181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:32.983000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:32.983385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:32.985294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:33.044678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 813/1657] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:33.053580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:33.084495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b7c7e-c7e5-4170-9939-fc5e0e0ad0b5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:33.125158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:33.130780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:33.132332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:33.133951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:33.137756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:33.158549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:33.299414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:33.406454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:33.406713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 845/1658] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:33 2022] POST /identity/v3/projects => generated 377 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:33.440394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085c2b3-a28c-46d6-9b26-5936f259e962 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:33.490316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:33.595442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:33.596298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:33.596781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:33.597159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:33.597973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:33.600106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:33.666554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 814/1659] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:33 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:22:33.671513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:33.721183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd627d3-2025-4d42-9a14-54bea0e0a817 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:33.739238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:33.740014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:33.740455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:33.741986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:33.742854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:33.755773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:33.787874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:33.809685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649cdc-4de0-444f-bbdd-ce5b92dc431a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:33.810378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 846/1660] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:33.821818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:33.823235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:33.824005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:33.824515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:33.825503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:33.827624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:33.874014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 815/1661] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:33.878769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:33.879386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:33.892949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:33.911001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91d0c-bc05-43cf-9f0c-b33f9e646dc9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:33.928744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:33.929387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:33.929665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:33.929941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] PATH_INFO: `/v3/projects/4f10cfcb354747f38cfd1128ae4f5a4b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:33.933290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f10cfcb354747f38cfd1128ae4f5a4b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:33.935705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:33.947522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132986-8a43-4a9e-a6a8-efa3ec10bccb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:33.970950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4efe6f-96c1-45a4-8cdc-2af618df99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:33.972925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4efe6f-96c1-45a4-8cdc-2af618df99c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:33.973803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4efe6f-96c1-45a4-8cdc-2af618df99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:33.975682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4efe6f-96c1-45a4-8cdc-2af618df99c8 admin admin] PATH_INFO: `/v3/projects/68e7ed3974fd41008d760347cfb71cac/users/12ebf7f5a98143d3b9bf2a8857550191/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.008376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4efe6f-96c1-45a4-8cdc-2af618df99c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e7ed3974fd41008d760347cfb71cac, user_id=12ebf7f5a98143d3b9bf2a8857550191, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:34.018309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4efe6f-96c1-45a4-8cdc-2af618df99c8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:34.053033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 816/1662] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:33 2022] PUT /identity/v3/projects/68e7ed3974fd41008d760347cfb71cac/users/12ebf7f5a98143d3b9bf2a8857550191/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:34.057831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f10cfcb354747f38cfd1128ae4f5a4b', 'request_id': 'req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.064139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:34.065029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:34.065480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.086870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f10cfcb354747f38cfd1128ae4f5a4b', 'request_id': 'req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.113302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f10cfcb354747f38cfd1128ae4f5a4b', 'request_id': 'req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.164164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] The token cache is being invalidate because project 4f10cfcb354747f38cfd1128ae4f5a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:34.164715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.168375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.178546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 847/1663] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:33 2022] DELETE /identity/v3/projects/4f10cfcb354747f38cfd1128ae4f5a4b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:34.178810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] MFA Rules not processed for user `12ebf7f5a98143d3b9bf2a8857550191`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:34.180710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:34.182258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:34.185625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:34.436717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 817/1664] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:34.438250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:34.443027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:34.449792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47257b-b5a7-42c8-8b27-ec27f85e64bd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:34.587477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476cda0-7fcf-469e-8adb-c801df8cbb01 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:34.594402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:34.595065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:34.595636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:34.595970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.597117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:34.599171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:34.629937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:34.677829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:34.678501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:34.678777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:34.679050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] PATH_INFO: `/v3/users/a97002dad8f54375b3e828f3f3461d8b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.686537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97002dad8f54375b3e828f3f3461d8b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:34.692887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 818/1665] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:34 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:34.695201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:34.698125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:34.715975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:34.861970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97002dad8f54375b3e828f3f3461d8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.863077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97002dad8f54375b3e828f3f3461d8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.883830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97002dad8f54375b3e828f3f3461d8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.908450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97002dad8f54375b3e828f3f3461d8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.930275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c7a2-efb4-4cb9-8c4f-06485c2f1509 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:34.937529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97002dad8f54375b3e828f3f3461d8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:34.951809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:34.952548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:34.952875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:34.953183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.953872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:34.956398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:34.966935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 848/1666] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:34 2022] DELETE /identity/v3/users/a97002dad8f54375b3e828f3f3461d8b => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:35.038055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 819/1667] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:34 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:35.040929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.041180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:35.228986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd6540-b2d7-410c-80b6-e40e14b0c8b9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.244125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.244866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.245148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.245424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.246160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.247943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.270519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 849/1668] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:35.274419 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.291575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991388c1-4b42-4904-af9f-5a2ec3065607 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.302740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.303694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.304103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.304451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] PATH_INFO: `/v3/projects/bdac63ab1caf4952a8b5170b601b7726/users/53fc6b1e034243a5987f2382fb522648/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.350484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdac63ab1caf4952a8b5170b601b7726, user_id=53fc6b1e034243a5987f2382fb522648, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.353458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.384798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 820/1669] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:35 2022] PUT /identity/v3/projects/bdac63ab1caf4952a8b5170b601b7726/users/53fc6b1e034243a5987f2382fb522648/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:35.391163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.413336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23004a-2c23-451c-9e15-7d9d28c3ece5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.567231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8382dd-2841-41e1-bb0c-01f09b176d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.568060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8382dd-2841-41e1-bb0c-01f09b176d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.568580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8382dd-2841-41e1-bb0c-01f09b176d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.569231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8382dd-2841-41e1-bb0c-01f09b176d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.569894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8382dd-2841-41e1-bb0c-01f09b176d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.572882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8382dd-2841-41e1-bb0c-01f09b176d08 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.591659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 850/1670] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:35.604262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.630852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ee835-39a8-4436-b213-c5555b9583bb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.645718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.646569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.646855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.647927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] PATH_INFO: `/v3/projects/bdac63ab1caf4952a8b5170b601b7726/users/53fc6b1e034243a5987f2382fb522648/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.652127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdac63ab1caf4952a8b5170b601b7726, user_id=53fc6b1e034243a5987f2382fb522648, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.661672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.700423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 821/1671] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:35 2022] PUT /identity/v3/projects/bdac63ab1caf4952a8b5170b601b7726/users/53fc6b1e034243a5987f2382fb522648/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:35.725065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab713db-9ae7-4938-bbeb-b367a544ab2c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.725634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab713db-9ae7-4938-bbeb-b367a544ab2c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.725738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab713db-9ae7-4938-bbeb-b367a544ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.796873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8ab713db-9ae7-4938-bbeb-b367a544ab2c None None] MFA Rules not processed for user `53fc6b1e034243a5987f2382fb522648`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:35.799054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8ab713db-9ae7-4938-bbeb-b367a544ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:35.849685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:36.094841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 851/1672] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:36.106533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:36.109191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:36.174988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:36.175279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:36.175557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:36.258311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] MFA Rules not processed for user `b80cf63a5f10485aa4a3869fa60d2300`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:36.261595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:36.297047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e48e-08f6-4acc-af36-bb2aff157aee admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:36.306707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:36.307434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:36.307762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:36.307952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:36.311589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:36.563167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 852/1673] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:36.564460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:36.570792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:36.602297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:36.605667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487baf89-71e8-47ae-8e01-c4cd86460a71 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:36.626549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:36.644238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 822/1674] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:36.646800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f55b-1a77-4f08-88a1-a112d1dd6bbe None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:36.647206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f55b-1a77-4f08-88a1-a112d1dd6bbe None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:36.647668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f55b-1a77-4f08-88a1-a112d1dd6bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:36.717849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0285f55b-1a77-4f08-88a1-a112d1dd6bbe None None] MFA Rules not processed for user `b80cf63a5f10485aa4a3869fa60d2300`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:36.719245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0285f55b-1a77-4f08-88a1-a112d1dd6bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:36.748378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 823/1675] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:36.809089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848b82-e5d3-4b19-9b13-0730b4849956 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:36.812468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848b82-e5d3-4b19-9b13-0730b4849956 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:36.816324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848b82-e5d3-4b19-9b13-0730b4849956 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:36.819529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 824/1676] 10.222.0.57 () {54 vars in 962 bytes} [Thu Sep 1 05:22:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:22:36.860875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:36.861347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:36.861899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:36.949487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d3c0-5c44-4832-ba17-68db7ec78a1c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:36.961068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:36.962064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:36.962565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:36.963322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] PATH_INFO: `/v3/projects/75df34ac1ba04a6086b470367f794530` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:36.965794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75df34ac1ba04a6086b470367f794530)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:36.970536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:36.977590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:36.980403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:37.095839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 825/1677] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Sep 1 05:22:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:37.105883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:37.112802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:37.131375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75df34ac1ba04a6086b470367f794530', 'request_id': 'req-33d2eff6-51db-4cf0-8936-cc223a695e98'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:37.142504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75df34ac1ba04a6086b470367f794530', 'request_id': 'req-33d2eff6-51db-4cf0-8936-cc223a695e98'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:37.174154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75df34ac1ba04a6086b470367f794530', 'request_id': 'req-33d2eff6-51db-4cf0-8936-cc223a695e98'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:37.198972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] The token cache is being invalidate because project 75df34ac1ba04a6086b470367f794530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:37.199754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:37.200793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-33d2eff6-51db-4cf0-8936-cc223a695e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:37.203210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64bfc-abc4-4349-8b94-bffcd614be4d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:37.204043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 853/1678] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:36 2022] DELETE /identity/v3/projects/75df34ac1ba04a6086b470367f794530 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:37.213600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7e5a7-8596-41cb-bebe-6331e80097d2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.214400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7e5a7-8596-41cb-bebe-6331e80097d2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.214888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7e5a7-8596-41cb-bebe-6331e80097d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.251361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-58e7e5a7-8596-41cb-bebe-6331e80097d2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:37.256146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-58e7e5a7-8596-41cb-bebe-6331e80097d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:37.365068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 854/1679] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:37.382369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.383397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.383792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.431952 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:37.433254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:37.453969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 855/1680] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:37.461557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:37.481719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2815-9ace-4aa6-a08a-1e38fdfad6c9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:37.490400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:37.491205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.491357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.491607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.492214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:37.492515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:37.494222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:37.541345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:37.542915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.543276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.543715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.556946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:37.560654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 856/1681] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:37.565760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:37.602852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940508-ede7-40d7-8e57-9c992b219e2d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:37.630737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:37.632153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.632986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.633763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.635219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:37.639319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:37.728180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 857/1682] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:37 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:37.732649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:37.737504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:37.741050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:37.764297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 826/1683] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:37.969625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dd3f2-d10a-4669-9200-871072dc156a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:37.990332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:37.991346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.992684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.995477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.995477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:38.003397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:38.063949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 858/1684] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:37 2022] POST /identity/v3/users => generated 292 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:38.066401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.123108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ef70-26bd-4fe3-a695-f45c0679b969 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.157037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.158074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.158468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.158751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.170907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:38.172578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:38.211270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 827/1685] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:38.217741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.233250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c7fc0-6887-4439-9568-72dbb8938fe8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.247006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc84ac-4975-4b6a-bf1c-ea4c01a2bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.248256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc84ac-4975-4b6a-bf1c-ea4c01a2bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.248901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc84ac-4975-4b6a-bf1c-ea4c01a2bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.249183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc84ac-4975-4b6a-bf1c-ea4c01a2bdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.249874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc84ac-4975-4b6a-bf1c-ea4c01a2bdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:38.255286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc84ac-4975-4b6a-bf1c-ea4c01a2bdc9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:38.284592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 859/1686] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:38.291777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.310490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509002-45cd-4455-a9d6-b9d9f13ac043 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.329550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728f502-0c7e-43ce-b6ed-0a6765af8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.330789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f502-0c7e-43ce-b6ed-0a6765af8646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.331349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f502-0c7e-43ce-b6ed-0a6765af8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.332915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f502-0c7e-43ce-b6ed-0a6765af8646 admin admin] PATH_INFO: `/v3/projects/faff0dc7cdcd4374952171029cc2e93c/users/7c904b64122b421e95fb98fb3c2a2271/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.361162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:38.410378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f502-0c7e-43ce-b6ed-0a6765af8646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faff0dc7cdcd4374952171029cc2e93c, user_id=7c904b64122b421e95fb98fb3c2a2271, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:38.422260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f502-0c7e-43ce-b6ed-0a6765af8646 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:38.486959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 828/1687] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:38 2022] PUT /identity/v3/projects/faff0dc7cdcd4374952171029cc2e93c/users/7c904b64122b421e95fb98fb3c2a2271/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:38.503920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.504283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.504565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.509598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31952-5868-46f0-b2d2-0d1f9fdc6412 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.509884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31952-5868-46f0-b2d2-0d1f9fdc6412 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.510165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31952-5868-46f0-b2d2-0d1f9fdc6412 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.512436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 829/1688] 10.222.0.57 () {54 vars in 912 bytes} [Thu Sep 1 05:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:22:38.516924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:38.518618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.518964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.519297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.595640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:38.598085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:38.604674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] MFA Rules not processed for user `7c904b64122b421e95fb98fb3c2a2271`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:38.605964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:38.762274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 860/1689] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:38.762274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.764305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:38.805992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 830/1690] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:22:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:38.807826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.922809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0becd5-5b6b-49f2-8efb-8d84c01026de None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.932390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.933072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.935401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.939755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.942467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:38.993634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05561145-0b7f-42c5-b0dc-f56c3a51ed0d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.009858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.014150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.014625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.015284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.016020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.021065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.102668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 831/1691] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:38 2022] POST /identity/v3/projects => generated 383 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:39.105668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.109126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:39.175136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.182460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.237409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 861/1692] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:39.239327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.309077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94affa-a1ee-452f-a9db-46c357a260ca service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.464387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:39.508754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cdc73-8ed5-4978-807e-903532db7cd4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.528287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.530360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.530863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.531346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.591495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:39.720552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.727847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.728416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.728944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.730218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.733993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.839960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 862/1693] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:39 2022] POST /identity/v3/users => generated 298 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:39.846408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.900005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d59e5-05fe-4541-8026-31b99b972043 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.921049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.922091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.928400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.929156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.930568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.933817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.962540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.969532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.992523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 863/1694] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:39.999380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.018539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 832/1695] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:40.030979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45273-42c2-42b0-8c87-e21a3d1c9226 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.039130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.040021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.040301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.040574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] PATH_INFO: `/v3/projects/40fb9a71c00b4c6d9a74287d9097a297/users/369165d4bcb54e4db74c38811a659b38/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.074533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb9a71c00b4c6d9a74287d9097a297, user_id=369165d4bcb54e4db74c38811a659b38, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.080037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.126482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 864/1696] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:39 2022] PUT /identity/v3/projects/40fb9a71c00b4c6d9a74287d9097a297/users/369165d4bcb54e4db74c38811a659b38/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:40.127974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.184978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778400e-c5e2-4550-adca-22aa871b3a46 service glance] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.526662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78dff4-b75d-436e-98cd-d3b3b6821a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.528030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78dff4-b75d-436e-98cd-d3b3b6821a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.528473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78dff4-b75d-436e-98cd-d3b3b6821a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.529081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78dff4-b75d-436e-98cd-d3b3b6821a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.530406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78dff4-b75d-436e-98cd-d3b3b6821a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.539377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78dff4-b75d-436e-98cd-d3b3b6821a65 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.571849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 833/1697] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:22:40.579056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.616475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2a4b-cdc9-45ab-86e5-35f165ddaec4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.646782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.647534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.647977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.648253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] PATH_INFO: `/v3/projects/40fb9a71c00b4c6d9a74287d9097a297/users/369165d4bcb54e4db74c38811a659b38/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.655843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb9a71c00b4c6d9a74287d9097a297, user_id=369165d4bcb54e4db74c38811a659b38, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.659633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.694885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 865/1698] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:40 2022] PUT /identity/v3/projects/40fb9a71c00b4c6d9a74287d9097a297/users/369165d4bcb54e4db74c38811a659b38/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:40.711411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f0751-0120-44dc-bb3d-0780a368732e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.711980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f0751-0120-44dc-bb3d-0780a368732e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.712640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f0751-0120-44dc-bb3d-0780a368732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.862118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7b1f0751-0120-44dc-bb3d-0780a368732e None None] MFA Rules not processed for user `369165d4bcb54e4db74c38811a659b38`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:40.863514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7b1f0751-0120-44dc-bb3d-0780a368732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:41.122350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 834/1699] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:41.142998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:41.341999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51435b1c-3c64-4cad-b758-55734f31fd12 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:41.342473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51435b1c-3c64-4cad-b758-55734f31fd12 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:41.342885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51435b1c-3c64-4cad-b758-55734f31fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:41.361238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:41.376820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acf19e-12bb-4acf-9e68-09135ae72cda admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:41.393640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee16c-35b5-47c9-9bfb-8606af155a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:41.395606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee16c-35b5-47c9-9bfb-8606af155a9f service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:41.396961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee16c-35b5-47c9-9bfb-8606af155a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:41.397347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee16c-35b5-47c9-9bfb-8606af155a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:41.412261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-51435b1c-3c64-4cad-b758-55734f31fd12 None None] MFA Rules not processed for user `3d27e93db5ec41e29196e6ff64608b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:41.413595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-51435b1c-3c64-4cad-b758-55734f31fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:41.425854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee16c-35b5-47c9-9bfb-8606af155a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:41.427675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee16c-35b5-47c9-9bfb-8606af155a9f service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:41.451827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 866/1700] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:22:41.615805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 835/1701] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:41.826947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c84df-c9c5-4ec4-a3ba-715358ed134b None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:41.827737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c84df-c9c5-4ec4-a3ba-715358ed134b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:41.828163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c84df-c9c5-4ec4-a3ba-715358ed134b None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:41.837522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 867/1702] 10.222.0.57 () {54 vars in 912 bytes} [Thu Sep 1 05:22:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:41.837955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:41.837955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:41.837955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:41.926372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc563f-e64f-4134-b562-4530f1cdcb36 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:41.926372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc563f-e64f-4134-b562-4530f1cdcb36 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:41.926372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc563f-e64f-4134-b562-4530f1cdcb36 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:41.927494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 868/1703] 10.222.0.57 () {54 vars in 912 bytes} [Thu Sep 1 05:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:41.940379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:41.940379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:41.940379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:41.986296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] MFA Rules not processed for user `98a43f7e512946aab3f1d7ef7b8d4fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:41.990133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:42.005719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:42.007879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:42.150266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 836/1704] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:42.153484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:42.156989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:42.171988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d18ef-7209-4b08-8808-461f018c5895 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:42.177110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:42.177912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:42.178347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:42.178714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:42.204212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 869/1705] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 01 05:22:42.207340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:42.209716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:42.231411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff885465-c9aa-4a9d-ac29-4e5b98078cea None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:42.238136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:42.238136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:42.239524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:42.239524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:42.251775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:42.256763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:42.276288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 870/1706] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:42.277598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:42.282119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:42.298378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:42.301551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:42.303052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:42.346829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 837/1707] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:42.383684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c67b0-fb11-4bdc-9876-adaa87738308 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:42.394119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8509-a612-4a8a-a328-cdc46c4ec163 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:42.394928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8509-a612-4a8a-a328-cdc46c4ec163 service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:42.396762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8509-a612-4a8a-a328-cdc46c4ec163 service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:42.397191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8509-a612-4a8a-a328-cdc46c4ec163 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:42.417821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c8509-a612-4a8a-a328-cdc46c4ec163 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:42.420955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c8509-a612-4a8a-a328-cdc46c4ec163 service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:42.446901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 871/1708] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:43.805799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:43.807277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:43.906099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:43.959569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330edd0-32e6-401c-8f22-7263c4bf22dd service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:43.967554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:43.969959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:43.971295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:43.973390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:43.976515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:43.994039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:43.996171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d5898-4d45-44ad-bcca-3cf5edfadf30 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.012146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 838/1709] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:22:44.508960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4530-0027-4cad-8926-e94952e48817 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.509891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4530-0027-4cad-8926-e94952e48817 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.509891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4530-0027-4cad-8926-e94952e48817 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.511381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 872/1710] 10.222.0.57 () {54 vars in 912 bytes} [Thu Sep 1 05:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:22:44.525932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.526843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.527427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.599025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4530-0027-4cad-8926-e94952e48817 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.601554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2d6e4530-0027-4cad-8926-e94952e48817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:44.602830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] MFA Rules not processed for user `98a43f7e512946aab3f1d7ef7b8d4fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:44.610775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:44.659875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 839/1711] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:22:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:44.718404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.723172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:44.786548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345a91c-3eed-4a99-b8cd-cd4979e40498 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.797737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd428a-bbf9-474b-a2cb-10785dbb0385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.798605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd428a-bbf9-474b-a2cb-10785dbb0385 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.799009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd428a-bbf9-474b-a2cb-10785dbb0385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.799304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd428a-bbf9-474b-a2cb-10785dbb0385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.855652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4530-0027-4cad-8926-e94952e48817 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.858452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd428a-bbf9-474b-a2cb-10785dbb0385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:44.868388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd428a-bbf9-474b-a2cb-10785dbb0385 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.886987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.888038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.888513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.889752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] PATH_INFO: `/v3/users/12ebf7f5a98143d3b9bf2a8857550191` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.892660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ebf7f5a98143d3b9bf2a8857550191)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:44.913929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.932782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 840/1712] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:45.285469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ebf7f5a98143d3b9bf2a8857550191'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:45.292275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ebf7f5a98143d3b9bf2a8857550191'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:45.345332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ebf7f5a98143d3b9bf2a8857550191'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:45.367146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ebf7f5a98143d3b9bf2a8857550191'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:45.397243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ebf7f5a98143d3b9bf2a8857550191'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:45.445727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 873/1713] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:44 2022] DELETE /identity/v3/users/12ebf7f5a98143d3b9bf2a8857550191 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:45.454329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:45.457948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:45.460006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:45.510371 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:45.511825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:45.614803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 841/1714] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:45.633193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:45.635947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:45.813508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:45.927507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb01a3-f0d1-4d03-9432-5594363e045f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:45.948664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c14015-db07-43bb-a6d2-cc746d7a7a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:45.949498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c14015-db07-43bb-a6d2-cc746d7a7a8a service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:45.950211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c14015-db07-43bb-a6d2-cc746d7a7a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:45.950947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c14015-db07-43bb-a6d2-cc746d7a7a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:45.999972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c14015-db07-43bb-a6d2-cc746d7a7a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:46.003964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c14015-db07-43bb-a6d2-cc746d7a7a8a service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:46.038764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 874/1715] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:46.204605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:46.207155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:46.278547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725e852-021d-4e18-bf45-490bc4506d66 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:46.316536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:46.318414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:46.320179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:46.322343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] PATH_INFO: `/v3/users/7c904b64122b421e95fb98fb3c2a2271` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:46.330703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c904b64122b421e95fb98fb3c2a2271)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:46.354686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:46.541583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c904b64122b421e95fb98fb3c2a2271'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:46.564451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c904b64122b421e95fb98fb3c2a2271'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:46.565492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c904b64122b421e95fb98fb3c2a2271'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:46.602983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c904b64122b421e95fb98fb3c2a2271'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:46.620138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c904b64122b421e95fb98fb3c2a2271'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:46.636975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 842/1716] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:46 2022] DELETE /identity/v3/users/7c904b64122b421e95fb98fb3c2a2271 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:46.643145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:46.643707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:46.644064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:46.681990 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:46.684716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:46.758661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:46.760947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:46.801625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:46.930704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6feb-e17c-4bbc-a778-a1cb2515ab50 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:46.952114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:46.956857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:46.958918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:46.962661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] PATH_INFO: `/v3/projects/68e7ed3974fd41008d760347cfb71cac` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:46.964543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e7ed3974fd41008d760347cfb71cac)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:46.968305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:47.157134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e7ed3974fd41008d760347cfb71cac', 'request_id': 'req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:47.194105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e7ed3974fd41008d760347cfb71cac', 'request_id': 'req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:47.230085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e7ed3974fd41008d760347cfb71cac', 'request_id': 'req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:47.272023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 875/1717] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:47.286444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:47.289217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:47.298922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] The token cache is being invalidate because project 68e7ed3974fd41008d760347cfb71cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:47.299412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:47.302926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:47.314046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 843/1718] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:46 2022] DELETE /identity/v3/projects/68e7ed3974fd41008d760347cfb71cac => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:47.321430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:47.325302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:47.625569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cddda-c56d-49d9-83c1-83c6de70cd80 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:47.764615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d60ee-23e6-42f7-8dd4-b42f9e24e896 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:47.792374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:47.792374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:47.792374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:47.792374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] PATH_INFO: `/v3/users/53fc6b1e034243a5987f2382fb522648` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:47.792897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fc6b1e034243a5987f2382fb522648)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:47.807335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:47.865899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:47.869823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:47.869823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:47.869823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:47.878786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:47.945408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:47.953978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1964f30-f727-4d0a-8067-ab9b07833ba2 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:47.995764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fc6b1e034243a5987f2382fb522648'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:48.007369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 876/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:22:48.017125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fc6b1e034243a5987f2382fb522648'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:48.018066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fc6b1e034243a5987f2382fb522648'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:48.045205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:48.098882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fc6b1e034243a5987f2382fb522648'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:48.135072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fc6b1e034243a5987f2382fb522648'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:48.191651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 844/1720] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:47 2022] DELETE /identity/v3/users/53fc6b1e034243a5987f2382fb522648 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:48.537594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761f539-07c8-407a-8fe8-ffbee99478d8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:48.545094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761f539-07c8-407a-8fe8-ffbee99478d8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:48.545469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761f539-07c8-407a-8fe8-ffbee99478d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:48.794293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2761f539-07c8-407a-8fe8-ffbee99478d8 None None] MFA Rules not processed for user `8c8ad3919d764781a90420e48c65df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:48.804141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2761f539-07c8-407a-8fe8-ffbee99478d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:48.895207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:49.167882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 877/1721] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 631 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:49.192196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:49.194103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:49.429804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d3b36-d387-4fb7-9927-75fe5fd5e0b9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:49.478240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:49.480481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.480842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.482302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.536977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:49.538978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:49.588285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 845/1722] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:49.671102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.672502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.672907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.957824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:49.963148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:50.312325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 878/1723] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:22:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:50.731383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:50.734156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:50.783348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:50.791747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:51.013959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a36e3-2106-4182-9f09-09812e7ef939 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.032831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.034093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.034563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.035034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] PATH_INFO: `/v3/projects/faff0dc7cdcd4374952171029cc2e93c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.040429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=faff0dc7cdcd4374952171029cc2e93c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.047086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.109883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c299-f04e-47e3-ba68-5aca334f71c7 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.130537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.131519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.131885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.133157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.153040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.155826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.181535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:51.189830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 846/1724] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:22:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:22:51.193728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:51.196073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:51.229487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c13d01-0c69-4669-a6f4-503de7c099a2 service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.229782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faff0dc7cdcd4374952171029cc2e93c', 'request_id': 'req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.279003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faff0dc7cdcd4374952171029cc2e93c', 'request_id': 'req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.310515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faff0dc7cdcd4374952171029cc2e93c', 'request_id': 'req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.335255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] The token cache is being invalidate because project faff0dc7cdcd4374952171029cc2e93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:51.335536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.336718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.343169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 879/1725] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:50 2022] DELETE /identity/v3/projects/faff0dc7cdcd4374952171029cc2e93c => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:22:51.345055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:51.347293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:51.355934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:51.426098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.428337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.429464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.429978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] PATH_INFO: `/v3/users/e6f1993f3d634c6b8fa4e89ce33dc2f7` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.431905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f1993f3d634c6b8fa4e89ce33dc2f7)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.436035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.470358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5bc3cc-28f7-473c-be3a-3a10f82979fe admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.477767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.478836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.479051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.479459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] PATH_INFO: `/v3/users/369165d4bcb54e4db74c38811a659b38` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.481795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=369165d4bcb54e4db74c38811a659b38)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.485361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.611348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369165d4bcb54e4db74c38811a659b38'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.612534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369165d4bcb54e4db74c38811a659b38'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.632886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369165d4bcb54e4db74c38811a659b38'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.635251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f1993f3d634c6b8fa4e89ce33dc2f7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.665796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f1993f3d634c6b8fa4e89ce33dc2f7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.669214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f1993f3d634c6b8fa4e89ce33dc2f7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.670506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369165d4bcb54e4db74c38811a659b38'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.711311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f1993f3d634c6b8fa4e89ce33dc2f7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.732092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c4b9d785-82c2-4d6b-93a1-aa03608a00a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f1993f3d634c6b8fa4e89ce33dc2f7'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.740396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c04d84f8-0b1e-4901-8f9e-6b0f28331324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369165d4bcb54e4db74c38811a659b38'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:51.744068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 847/1726] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:51 2022] DELETE /identity/v3/users/e6f1993f3d634c6b8fa4e89ce33dc2f7 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:51.750702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.751344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.751830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.773359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 880/1727] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:51 2022] DELETE /identity/v3/users/369165d4bcb54e4db74c38811a659b38 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:51.835183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:51.842736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:52.043160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:52.043919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:52.043919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:52.055577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 848/1728] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:52.075956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] MFA Rules not processed for user `98a43f7e512946aab3f1d7ef7b8d4fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:52.077980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:52.097502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:52.099874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:52.205160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:52.260374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 881/1729] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Sep 1 05:22:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:52.263426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9fb5-6266-4b10-aae7-7bf0c75cd10a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:52.274325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:52.275136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:52.275136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:52.275508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:52.337882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:52.358980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:52.376652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:52.424494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:52.436904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b599-32b2-4970-a88d-a1414202c8bf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:52.451986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445f687-2922-41b9-a5c4-79b54ccb4731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:52.456085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f687-2922-41b9-a5c4-79b54ccb4731 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:52.456326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f687-2922-41b9-a5c4-79b54ccb4731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:52.456558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f687-2922-41b9-a5c4-79b54ccb4731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:52.470579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 849/1730] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:52.487524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445f687-2922-41b9-a5c4-79b54ccb4731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:52.489075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445f687-2922-41b9-a5c4-79b54ccb4731 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:52.519165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 882/1731] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:22:52.968870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:52.970449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:52.995712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531d6c-2cc3-48ec-b810-fcfeb7814a82 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:52.996125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531d6c-2cc3-48ec-b810-fcfeb7814a82 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:52.996284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531d6c-2cc3-48ec-b810-fcfeb7814a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.008261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169ea17-192e-4b77-b3a8-9a73eb889ffe service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:53.039025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:53.039745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:53.040088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:53.040309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] PATH_INFO: `/v3/projects/bdac63ab1caf4952a8b5170b601b7726` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.041645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdac63ab1caf4952a8b5170b601b7726)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:53.047171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:53.084312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0b531d6c-2cc3-48ec-b810-fcfeb7814a82 None None] MFA Rules not processed for user `de343953c3f24a4fbf8277edb098f165`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:53.085707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0b531d6c-2cc3-48ec-b810-fcfeb7814a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:53.222281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdac63ab1caf4952a8b5170b601b7726', 'request_id': 'req-c74f287d-91c5-424d-a5a8-2598bd0d32c2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:53.244234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdac63ab1caf4952a8b5170b601b7726', 'request_id': 'req-c74f287d-91c5-424d-a5a8-2598bd0d32c2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:53.274213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdac63ab1caf4952a8b5170b601b7726', 'request_id': 'req-c74f287d-91c5-424d-a5a8-2598bd0d32c2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:53.311962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] The token cache is being invalidate because project bdac63ab1caf4952a8b5170b601b7726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:53.313250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:53.319775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c74f287d-91c5-424d-a5a8-2598bd0d32c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:53.327554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 850/1732] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:52 2022] DELETE /identity/v3/projects/bdac63ab1caf4952a8b5170b601b7726 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:53.340665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 883/1733] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:22:53.341262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83750ce6-54a5-4b4f-bdc4-4d2de16eeed4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:53.341262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83750ce6-54a5-4b4f-bdc4-4d2de16eeed4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:53.341262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83750ce6-54a5-4b4f-bdc4-4d2de16eeed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.413701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-83750ce6-54a5-4b4f-bdc4-4d2de16eeed4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:53.415562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-83750ce6-54a5-4b4f-bdc4-4d2de16eeed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:53.586329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:53.586780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:53.587404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.694349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 851/1734] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:53.704105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:53.712514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:53.717092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.775510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] MFA Rules not processed for user `c53e53ea051c4594b6c84f4ae58ac43f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:53.778069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:53.869437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:53.875294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:53.895716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 852/1735] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:53.897654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:53.909056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:54.079580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 884/1736] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 01 05:22:54.083054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.118583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acac1c-209c-4d42-89d0-b49ed0bb99a6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.133702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.135367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.136295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.137059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.138636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:54.141779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.143839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4bb7c-1cf4-4d39-8f3a-51b34aa33577 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.163085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74db8f-5b52-44c8-be13-436501445379 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.179647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 885/1737] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:54.179647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.179647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.179647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.184417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.185097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.185367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.185644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.190050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:54.203550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:54.213392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] MFA Rules not processed for user `c53e53ea051c4594b6c84f4ae58ac43f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:54.215630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:54.224507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 886/1738] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:54.225884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.243906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120200e2-3e5f-4975-b7c8-e22f2c10001e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.255306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.257809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.267699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.268952 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.270807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.276333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.352908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.358795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.384959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 853/1739] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:54.428835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 887/1740] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:54 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:54.435599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.461156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de39a-9cd6-49bd-915f-c8ed471ef671 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.549679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.588205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:54.644515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.646792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.646792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.646939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.649575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.653433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.728385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 854/1741] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:54 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:54.734202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.749019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d261780-254c-41e5-a7bb-ac7e5557f47e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.754325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a074e8-b896-4fe8-9813-e2bfa0af91f0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.762782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.764426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.766588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c14b7-6b00-4d04-9572-0df5e38d8514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.767212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.767346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c14b7-6b00-4d04-9572-0df5e38d8514 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.767699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c14b7-6b00-4d04-9572-0df5e38d8514 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.767943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.768055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c14b7-6b00-4d04-9572-0df5e38d8514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.768932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.775930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.842459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 855/1742] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:22:54.853835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.900177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b72274-f914-49ef-8cf1-2408420f1ef5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.921949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.925354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.925878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.928136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.929208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.933731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.935565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c14b7-6b00-4d04-9572-0df5e38d8514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.939513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c14b7-6b00-4d04-9572-0df5e38d8514 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.971262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 856/1743] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:54.976763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.984381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 888/1744] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:22:55.017027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b9580-25b2-44e9-b578-03f00a0a67df admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.037277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.038396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.039485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.041230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] PATH_INFO: `/v3/projects/ae9ed8bab6be49a7939fb75097b37235/users/50d5a00ec4774a2abe047d2a2d2cd133/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.089134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9ed8bab6be49a7939fb75097b37235, user_id=50d5a00ec4774a2abe047d2a2d2cd133, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:55.103317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:55.150063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 857/1745] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:54 2022] PUT /identity/v3/projects/ae9ed8bab6be49a7939fb75097b37235/users/50d5a00ec4774a2abe047d2a2d2cd133/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:55.163521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.164312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.164752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.324411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] MFA Rules not processed for user `50d5a00ec4774a2abe047d2a2d2cd133`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:55.326209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:55.536508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 889/1746] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:55.539724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:55.871292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:55.898567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6826bc-4d3d-4b7f-a16d-a7ca94b0b8e7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.939824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.940401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.940723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.944194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.946294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:55.953248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.047241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 858/1747] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:55 2022] POST /identity/v3/projects => generated 377 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:56.048710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.086791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f7e1c-19bb-4632-8291-4477fe4a9b51 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.238628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:56.330242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.333700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.333998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.334273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.338401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.343740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.440678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 890/1748] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:56 2022] POST /identity/v3/users => generated 289 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:56.443868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.463553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6887bc-3790-4440-ac52-c528c88f168f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.495464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.495464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.495464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.495464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.495830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.495830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.544698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 859/1749] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:56.545712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.598509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce5af-c37c-4649-9a98-b41539345280 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.624657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.636037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.640106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.640106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.641521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.652010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.688096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 891/1750] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:56.691854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.725603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750f78-de60-4153-8007-fc4f1c8f008f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.760187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a609-e377-40e5-97c8-1bcd2922d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.762258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a609-e377-40e5-97c8-1bcd2922d957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.769213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a609-e377-40e5-97c8-1bcd2922d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.769607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a609-e377-40e5-97c8-1bcd2922d957 admin admin] PATH_INFO: `/v3/projects/db3a41c497d14751ac2f79212af2ab0f/users/8a239847cc9f4613877d23f6388dd8b1/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.817483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.817925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:56.831667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a609-e377-40e5-97c8-1bcd2922d957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3a41c497d14751ac2f79212af2ab0f, user_id=8a239847cc9f4613877d23f6388dd8b1, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.840121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a609-e377-40e5-97c8-1bcd2922d957 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.848314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80a15-fe11-4132-ac66-78f1fc735d83 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.864821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.865939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.866482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.866965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] PATH_INFO: `/v3/projects/40fb9a71c00b4c6d9a74287d9097a297` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.869205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fb9a71c00b4c6d9a74287d9097a297)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.875827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.915742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 860/1751] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:56 2022] PUT /identity/v3/projects/db3a41c497d14751ac2f79212af2ab0f/users/8a239847cc9f4613877d23f6388dd8b1/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:56.931682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d514f-a791-45b5-845f-69cbcbb61f56 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.931971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d514f-a791-45b5-845f-69cbcbb61f56 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.932321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d514f-a791-45b5-845f-69cbcbb61f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:57.164970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cb3d514f-a791-45b5-845f-69cbcbb61f56 None None] MFA Rules not processed for user `8a239847cc9f4613877d23f6388dd8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:57.166251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cb3d514f-a791-45b5-845f-69cbcbb61f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:57.201288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fb9a71c00b4c6d9a74287d9097a297', 'request_id': 'req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.246157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fb9a71c00b4c6d9a74287d9097a297', 'request_id': 'req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.283316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fb9a71c00b4c6d9a74287d9097a297', 'request_id': 'req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.359159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] The token cache is being invalidate because project 40fb9a71c00b4c6d9a74287d9097a297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:57.363600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.367629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.391398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 892/1752] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:56 2022] DELETE /identity/v3/projects/40fb9a71c00b4c6d9a74287d9097a297 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:57.392404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:57.397229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:57.424174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 861/1753] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:57.424174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:57.424174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:57.424174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:57.506718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:57.511988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:57.577118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f29a3-46cc-4d14-8e7d-6ee066158e18 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:57.585974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:57.587269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:57.598811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:57.599431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] PATH_INFO: `/v3/projects/cbf45d937ab949b28ada715ce874340b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:57.622455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf45d937ab949b28ada715ce874340b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:57.626798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:57.714648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 862/1754] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:57.715522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:57.722277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:57.743081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977401-8ab3-46f0-8954-0562f73d92d8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:57.760322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6311492-cf52-4374-995a-ad3f7763feca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:57.760892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311492-cf52-4374-995a-ad3f7763feca admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:57.761165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311492-cf52-4374-995a-ad3f7763feca admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:57.762155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311492-cf52-4374-995a-ad3f7763feca admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:57.762838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6311492-cf52-4374-995a-ad3f7763feca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:57.764973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6311492-cf52-4374-995a-ad3f7763feca admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:57.839231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:57.850475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf45d937ab949b28ada715ce874340b', 'request_id': 'req-503597b3-5fb9-4291-81a8-4e98a991028d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.864834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf45d937ab949b28ada715ce874340b', 'request_id': 'req-503597b3-5fb9-4291-81a8-4e98a991028d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.894738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf45d937ab949b28ada715ce874340b', 'request_id': 'req-503597b3-5fb9-4291-81a8-4e98a991028d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.900790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 863/1755] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:57 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:57.902429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:57.909261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:57.909716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:57.913571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] The token cache is being invalidate because project cbf45d937ab949b28ada715ce874340b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:22:57.914024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.916181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:57.928286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 893/1756] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:22:57 2022] DELETE /identity/v3/projects/cbf45d937ab949b28ada715ce874340b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:57.929767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:57.933990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:58.015384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:58.017357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:58.054742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:58.164139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503597b3-5fb9-4291-81a8-4e98a991028d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:58.280830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 864/1757] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:58.281974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:58.283992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:58.317299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a1093-950d-4079-af8b-04b4c8eab598 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:58.340734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:58.341453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.341741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.342019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] PATH_INFO: `/v3/users/a758209bf6884184b03736d3e630a14a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.343724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a758209bf6884184b03736d3e630a14a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:58.346105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:58.481996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a758209bf6884184b03736d3e630a14a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:58.497257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:58.501294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.503129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.503591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.504752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:58.525054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:58.532167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a758209bf6884184b03736d3e630a14a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:58.533650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a758209bf6884184b03736d3e630a14a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:58.571795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a758209bf6884184b03736d3e630a14a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:58.626937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 894/1758] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:57 2022] POST /identity/v3/users => generated 296 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:58.626937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:58.634860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5215ebde-c507-452f-9fc5-86c92f9fff00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a758209bf6884184b03736d3e630a14a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:22:58.664130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 865/1759] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:22:58 2022] DELETE /identity/v3/users/a758209bf6884184b03736d3e630a14a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:58.665714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9781a5-c26f-48e4-b3a0-ea6f878c38b7 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.666026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9781a5-c26f-48e4-b3a0-ea6f878c38b7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.667988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e624a5b-377e-4a92-9542-117e30730a7f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:58.671165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9781a5-c26f-48e4-b3a0-ea6f878c38b7 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.677947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 866/1760] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:22:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:58.679227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9781a5-c26f-48e4-b3a0-ea6f878c38b7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:58.687345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ad9781a5-c26f-48e4-b3a0-ea6f878c38b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:58.937225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9781a5-c26f-48e4-b3a0-ea6f878c38b7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:58.945361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:58.946011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.946286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.951378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.951734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:58.952178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:58.955912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45a173-ed0c-407c-8230-1793f8a704c2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:58.969710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e309-768a-40be-be94-794f27c5f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:58.984602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e309-768a-40be-be94-794f27c5f83d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.986071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e309-768a-40be-be94-794f27c5f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.988527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e309-768a-40be-be94-794f27c5f83d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.991978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 895/1761] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:58.993407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.993687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.994092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.995613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542e309-768a-40be-be94-794f27c5f83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:59.001506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542e309-768a-40be-be94-794f27c5f83d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:59.018034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:59.040831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 867/1762] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:22:59.046527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.046816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.047095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.076792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] MFA Rules not processed for user `c53e53ea051c4594b6c84f4ae58ac43f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:59.081194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:59.129856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:59.131269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:59.167316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:59.330365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 896/1763] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:22:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:59.330365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.330365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:59.363614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd710a-ea68-4419-8516-3fade630f782 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:59.375933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:59.376465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.376770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.377038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.377727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:59.383239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:59.455986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 897/1764] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:22:59 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:59.455986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.461635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 868/1765] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:22:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:22:59.467860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.612739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830498bc-3c68-473b-b413-7a373ecee8b6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:59.664293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45827-5d37-4d70-99b0-5cd84d010bd1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:59.697826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:59.698543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.698816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.699088 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] PATH_INFO: `/v3/projects/dbe42021a2114dcdbeb7bf1612e4b736/users/db23ca2108f64076a0a9209ac487b47e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.766934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe42021a2114dcdbeb7bf1612e4b736, user_id=db23ca2108f64076a0a9209ac487b47e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:59.784081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:59.836707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 898/1766] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:22:59 2022] PUT /identity/v3/projects/dbe42021a2114dcdbeb7bf1612e4b736/users/db23ca2108f64076a0a9209ac487b47e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:59.838643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.887369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:59.889662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.890479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.891566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.893515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:59.900394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:59.971273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 869/1767] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:22:59 2022] POST /identity/v3/users => generated 284 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:59.979342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.043611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b49e-85b1-42a2-9152-cf8307a2f4b8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.109072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340428c-d254-4c1b-bb3d-61bf8731c0b0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.155000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.158482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.158781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.162253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.165624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.171813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.220843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 899/1768] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:00.222089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.224000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:00.252936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.273980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.281500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.285181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.288404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.292292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.301259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.345375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 870/1769] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:00.365617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.404523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e840f3-f625-4936-8e3e-56e3896e8379 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.425743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.426534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.426821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.427219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] PATH_INFO: `/v3/projects/dbe42021a2114dcdbeb7bf1612e4b736/users/db23ca2108f64076a0a9209ac487b47e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.437402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe42021a2114dcdbeb7bf1612e4b736, user_id=db23ca2108f64076a0a9209ac487b47e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.440908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.471341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 871/1770] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:00 2022] PUT /identity/v3/projects/dbe42021a2114dcdbeb7bf1612e4b736/users/db23ca2108f64076a0a9209ac487b47e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:00.472276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.539322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.551471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ca3ff-de2c-45ef-a7d3-698d69645799 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.656682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0814e63-c098-4b44-b620-83e149bdad5c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.671759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897f44-46be-47ae-9078-aa297296669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.672470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897f44-46be-47ae-9078-aa297296669c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.672850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897f44-46be-47ae-9078-aa297296669c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.673235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897f44-46be-47ae-9078-aa297296669c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.674201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12897f44-46be-47ae-9078-aa297296669c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.676675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12897f44-46be-47ae-9078-aa297296669c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.711873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 872/1771] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:00.713365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.713650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.713925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.774889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.777875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.778383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.778511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.787022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] MFA Rules not processed for user `db23ca2108f64076a0a9209ac487b47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:00.788365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:00.791826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.793693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.823586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 900/1772] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:00.824611 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.877273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca40033-4d18-4793-ad20-38ede6577189 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.893358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6c65a-838b-433e-ab3e-d71efdf6f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.894195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6c65a-838b-433e-ab3e-d71efdf6f516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.894474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6c65a-838b-433e-ab3e-d71efdf6f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.894745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6c65a-838b-433e-ab3e-d71efdf6f516 admin admin] PATH_INFO: `/v3/projects/a01b791c096f475fa2e3249b43a4a6e0/users/70dbf209ca604edebf655581a74841ae/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.970094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6c65a-838b-433e-ab3e-d71efdf6f516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01b791c096f475fa2e3249b43a4a6e0, user_id=70dbf209ca604edebf655581a74841ae, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.979214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6c65a-838b-433e-ab3e-d71efdf6f516 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:01.026639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 901/1773] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:00 2022] PUT /identity/v3/projects/a01b791c096f475fa2e3249b43a4a6e0/users/70dbf209ca604edebf655581a74841ae/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:01.042895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.043426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.043793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.082759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 873/1774] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:01.101614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:01.104553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:01.174933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] MFA Rules not processed for user `70dbf209ca604edebf655581a74841ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:01.182684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:01.377160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522bda8-586e-4ac7-9ac2-11351e60b926 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:01.415028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:01.474016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 902/1775] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:01.479045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:01.588589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:01.591773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.592869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.593812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.681035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:01.819563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994776-fd9c-42b9-a527-e8d0731d1cb9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:01.850653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:01.853104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.856188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.857341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.861736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:01.878861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:02.018635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:02.040475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:02.096037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 903/1776] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:01 2022] POST /identity/v3/projects => generated 367 bytes in 615 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:02.097944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:02.137659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 874/1777] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 1036 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:02.235625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:02.239700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:02.327610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb8c97-8d6f-4440-949d-e04e3786d6cd service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:02.479164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05709902-c4cb-45a3-a741-354e0e2fa81d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:02.511084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:02.511740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:02.512018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:02.512668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:02.515127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:02.515127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:02.611737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 904/1778] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:02 2022] POST /identity/v3/users => generated 290 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:23:02.613321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:02.617608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:02.638683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:02.642000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:02.643633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:02.643787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] PATH_INFO: `/v3/projects/4a63b5057ab84c908dec1bc28eeff9cc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:02.649359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a63b5057ab84c908dec1bc28eeff9cc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:02.655700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:02.797011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b1c5-7568-4fdb-9618-b198139f73cd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:02.818378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:02.821603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:02.822268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:02.822268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:02.834341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:02.860153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a63b5057ab84c908dec1bc28eeff9cc', 'request_id': 'req-84955d92-b4dc-4026-8bdf-668b1e408c91'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:02.884831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a63b5057ab84c908dec1bc28eeff9cc', 'request_id': 'req-84955d92-b4dc-4026-8bdf-668b1e408c91'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:02.900811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a63b5057ab84c908dec1bc28eeff9cc', 'request_id': 'req-84955d92-b4dc-4026-8bdf-668b1e408c91'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:02.934367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] The token cache is being invalidate because project 4a63b5057ab84c908dec1bc28eeff9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:02.934710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:02.939451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:02.946475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 875/1779] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:02 2022] DELETE /identity/v3/projects/4a63b5057ab84c908dec1bc28eeff9cc => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:02.947625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:02.948795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:02.952838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:03.078980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:03.130607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955d92-b4dc-4026-8bdf-668b1e408c91 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:03.132113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:03.136155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:03.147142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b233621-b7bc-4984-a10b-2271b9be49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:03.147883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233621-b7bc-4984-a10b-2271b9be49f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.148079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233621-b7bc-4984-a10b-2271b9be49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.148354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233621-b7bc-4984-a10b-2271b9be49f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.149580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b233621-b7bc-4984-a10b-2271b9be49f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:03.152823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b233621-b7bc-4984-a10b-2271b9be49f5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:03.180908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 876/1780] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:03.182435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cbadb-4fd3-4364-b363-e1232991c700 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.182717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cbadb-4fd3-4364-b363-e1232991c700 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.183044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cbadb-4fd3-4364-b363-e1232991c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.193377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 905/1781] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:03.194525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:03.232849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed28107-2e53-4ccc-81f1-90433a5ae45e service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:03.233727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a74cbadb-4fd3-4364-b363-e1232991c700 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:03.235121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a74cbadb-4fd3-4364-b363-e1232991c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:03.249601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:03.251517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.256737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.257028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] PATH_INFO: `/v3/projects/1b4f7df8a877409b8c9c47b645235bff/users/66a378323e5b4897a3806e2692c11b1e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.269572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 877/1782] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:03.271090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.272778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.273073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.281525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4f7df8a877409b8c9c47b645235bff, user_id=66a378323e5b4897a3806e2692c11b1e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:03.286729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:03.328115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:03.329923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:03.350588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 906/1783] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:03 2022] PUT /identity/v3/projects/1b4f7df8a877409b8c9c47b645235bff/users/66a378323e5b4897a3806e2692c11b1e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:03.368560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:03.544213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 878/1784] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:03.545495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:03.573335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426fd4-2bd9-404f-96f7-b9a60cc24923 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:03.600006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:03.600996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.601436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.601864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.602725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:03.603204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:03.605146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00d1e9-973a-4f11-870c-28bff46ad2ea admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:03.649435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 879/1785] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:03.659774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.660495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.660841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.700665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac73fd-b74c-4009-8d73-6d9d62f1e58b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:03.748206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:03.748897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.749186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.749448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.750114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:03.752012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:03.788226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] MFA Rules not processed for user `8c8ad3919d764781a90420e48c65df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:03.791819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:03.826730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 907/1786] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:03.827739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:03.868946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb687e-638a-4467-8876-45635b12d743 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:03.890267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:03.890963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:03.891308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:03.891557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:03.892460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:03.894566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:03.993951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 908/1787] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:03 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:03.994860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.050804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 880/1788] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:04.050804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.086362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32e9a2-f9f3-47a2-a62d-fed32675aa28 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:04.239612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f6dfc-26b1-4748-828d-a81fc64aab5f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:04.262458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be2e8-6ee0-4500-9e24-db42fd4e6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:04.274313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be2e8-6ee0-4500-9e24-db42fd4e6b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.274597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be2e8-6ee0-4500-9e24-db42fd4e6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.274885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be2e8-6ee0-4500-9e24-db42fd4e6b13 admin admin] PATH_INFO: `/v3/projects/1b4f7df8a877409b8c9c47b645235bff/users/66a378323e5b4897a3806e2692c11b1e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.291548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7be2e8-6ee0-4500-9e24-db42fd4e6b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4f7df8a877409b8c9c47b645235bff, user_id=66a378323e5b4897a3806e2692c11b1e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:04.304097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:04.305224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.305727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.306153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.306266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7be2e8-6ee0-4500-9e24-db42fd4e6b13 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:04.306944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:04.309136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:04.328188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:04.367326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 881/1789] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:04 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:04.371376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.374665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 909/1790] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:03 2022] PUT /identity/v3/projects/1b4f7df8a877409b8c9c47b645235bff/users/66a378323e5b4897a3806e2692c11b1e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:04.386208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.386532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.386771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.390527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed4d1-13a4-42aa-b41e-f307f9c1b6b2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:04.437708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:04.558851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] MFA Rules not processed for user `66a378323e5b4897a3806e2692c11b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:04.572957 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:04.674962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa157931-77ea-4384-afe2-6e15bf715007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:04.678194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa157931-77ea-4384-afe2-6e15bf715007 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.684857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa157931-77ea-4384-afe2-6e15bf715007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.685151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa157931-77ea-4384-afe2-6e15bf715007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.686029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa157931-77ea-4384-afe2-6e15bf715007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:04.694538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa157931-77ea-4384-afe2-6e15bf715007 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:04.730463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 882/1791] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:04.741664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac859-69c5-4182-a09d-fbab216afbc0 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.742182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac859-69c5-4182-a09d-fbab216afbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.742341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac859-69c5-4182-a09d-fbab216afbc0 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.748855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 883/1792] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:23:04 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:23:04.749845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac859-69c5-4182-a09d-fbab216afbc0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.803713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac859-69c5-4182-a09d-fbab216afbc0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:04.828449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:04.833249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.834108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.835175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.838191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:04.846464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:04.965515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 910/1793] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 576 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:23:04.987016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 884/1794] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:04.989460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.995749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:04.999715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.070464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be641-d1cc-442a-a843-90b1291a4342 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.116915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138dd85-991f-4410-b100-6e310b6e9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.118219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dd85-991f-4410-b100-6e310b6e9885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.118378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dd85-991f-4410-b100-6e310b6e9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.118573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dd85-991f-4410-b100-6e310b6e9885 admin admin] PATH_INFO: `/v3/projects/cf02223180454d92bbbf30269c63abf9/users/e272c7da3dde435eb4588e9e1fa232ab/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.192260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138dd85-991f-4410-b100-6e310b6e9885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf02223180454d92bbbf30269c63abf9, user_id=e272c7da3dde435eb4588e9e1fa232ab, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:05.221734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138dd85-991f-4410-b100-6e310b6e9885 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:05.236926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea326-dcf8-4c6f-8a76-1de8e20c4629 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.277566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52029461-dd24-4970-97ee-2ef3586e478e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.278230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029461-dd24-4970-97ee-2ef3586e478e service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.278508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029461-dd24-4970-97ee-2ef3586e478e service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.279535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029461-dd24-4970-97ee-2ef3586e478e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.323208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 911/1795] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:04 2022] PUT /identity/v3/projects/cf02223180454d92bbbf30269c63abf9/users/e272c7da3dde435eb4588e9e1fa232ab/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:05.345872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52029461-dd24-4970-97ee-2ef3586e478e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:05.348344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52029461-dd24-4970-97ee-2ef3586e478e service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:05.349423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.355745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.356456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.392053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 885/1796] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:05.574707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.574899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.575180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.584685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] MFA Rules not processed for user `e272c7da3dde435eb4588e9e1fa232ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:05.602607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:05.665332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:05.678469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:05.970613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 886/1797] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:23:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:05.971673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.981517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:06.048709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:06.133193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 912/1798] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 783 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:06.135835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.231273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4c0e5-5e73-49a0-aa68-18f37df703ce None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.246578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.251322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.251322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.254303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.261753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:06.408378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:06.417740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c325e-44fb-4c24-a849-6f7ae5415a80 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.436978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.438760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.439041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.439308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.441275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.444375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.490832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 913/1799] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:06 2022] POST /identity/v3/projects => generated 381 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:06.495518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.572054 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.577290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.617033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 887/1800] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:06.742623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b7d7a-ded8-431c-9722-894154c52690 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.757639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.758304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.758580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.758936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.759619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.761754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.836295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 914/1801] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:06 2022] POST /identity/v3/users => generated 297 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:06.840666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.867978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d759e3-1167-4972-af74-343763d34818 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.892484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.893565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.894093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.894570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.895709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.898747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.956833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 888/1802] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:06.960112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.984438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321b82-8e38-4fba-b174-cd0f7951a70a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:07.003525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:07.011074 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:07.011480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:07.012002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] PATH_INFO: `/v3/projects/73f9173e79c944ff9a8767f5181d1bf0/users/210d80a703784d0fa3a2cb84fdcac70e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:07.056730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f9173e79c944ff9a8767f5181d1bf0, user_id=210d80a703784d0fa3a2cb84fdcac70e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:07.060206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:07.152225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 915/1803] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:06 2022] PUT /identity/v3/projects/73f9173e79c944ff9a8767f5181d1bf0/users/210d80a703784d0fa3a2cb84fdcac70e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:07.153923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:07.172918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e7af-b00c-4f4f-9b1c-c1b6b8db4596 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:07.433323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:07.434387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:07.434807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:07.435649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:07.452124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:07.471890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:07.508517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:07.510857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:07.527679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 889/1804] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:07.532491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:07.636870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8bab-2fe1-46e6-9b38-3e5f93e1baa2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:07.673243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86677e1c-c3d8-4930-96fe-a179e4511f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:07.683654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677e1c-c3d8-4930-96fe-a179e4511f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:07.684977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677e1c-c3d8-4930-96fe-a179e4511f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:07.688587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677e1c-c3d8-4930-96fe-a179e4511f80 admin admin] PATH_INFO: `/v3/projects/73f9173e79c944ff9a8767f5181d1bf0/users/210d80a703784d0fa3a2cb84fdcac70e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:07.706028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86677e1c-c3d8-4930-96fe-a179e4511f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f9173e79c944ff9a8767f5181d1bf0, user_id=210d80a703784d0fa3a2cb84fdcac70e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:07.719438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86677e1c-c3d8-4930-96fe-a179e4511f80 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:07.799446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 890/1805] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:07 2022] PUT /identity/v3/projects/73f9173e79c944ff9a8767f5181d1bf0/users/210d80a703784d0fa3a2cb84fdcac70e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:07.803711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:07.810971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:07.811894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:07.823986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f5a0-a66b-499d-a48b-ee6a18f2a965 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:07.966107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] MFA Rules not processed for user `210d80a703784d0fa3a2cb84fdcac70e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:07.983972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:08.009396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:08.089743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:08.110475 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:08.111683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:08.111683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:08.111683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:08.180361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:08.186065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:08.255257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 916/1806] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:23:08.256805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 891/1807] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:08.278445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:08.361418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de1e58-0f3a-4256-b410-0e64bcb6b446 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:08.366772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e803d98-ee51-4acd-b352-ee227b840eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:08.367856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e803d98-ee51-4acd-b352-ee227b840eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:08.369486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e803d98-ee51-4acd-b352-ee227b840eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:08.370336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e803d98-ee51-4acd-b352-ee227b840eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:08.415069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e803d98-ee51-4acd-b352-ee227b840eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:08.419584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e803d98-ee51-4acd-b352-ee227b840eaf service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:08.468973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 917/1808] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:08.566934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:08.573908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:08.784664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca25632-de90-4ab5-af6b-07fc8ab8d198 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:08.800244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:08.801172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:08.801599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:08.801856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] PATH_INFO: `/v3/users/50d5a00ec4774a2abe047d2a2d2cd133` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:08.803408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d5a00ec4774a2abe047d2a2d2cd133)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:08.807349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:08.918763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d5a00ec4774a2abe047d2a2d2cd133'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:08.941400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d5a00ec4774a2abe047d2a2d2cd133'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:08.942102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d5a00ec4774a2abe047d2a2d2cd133'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:08.964593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d5a00ec4774a2abe047d2a2d2cd133'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:08.973225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d5a00ec4774a2abe047d2a2d2cd133'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:08.983775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 892/1809] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:08 2022] DELETE /identity/v3/users/50d5a00ec4774a2abe047d2a2d2cd133 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:08.990563 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:08.990852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:08.991131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.030186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:09.034343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:09.240098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 918/1810] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:09.261735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:09.263681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:09.422822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:09.452980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c5fc6-e578-4d7d-87a4-427f614c6d1a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:09.458491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:09.461664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:09.465095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03a9fd-3ca1-4e1e-b3ab-5c03a3aad22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:09.467353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03a9fd-3ca1-4e1e-b3ab-5c03a3aad22a service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.469740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03a9fd-3ca1-4e1e-b3ab-5c03a3aad22a service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.470315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03a9fd-3ca1-4e1e-b3ab-5c03a3aad22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.502418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03a9fd-3ca1-4e1e-b3ab-5c03a3aad22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:09.504333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03a9fd-3ca1-4e1e-b3ab-5c03a3aad22a service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:09.544847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 893/1811] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:09.644237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14c08c-05b1-4126-b883-9f94878b474b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:09.656415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210d80a703784d0fa3a2cb84fdcac70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f9173e79c944ff9a8767f5181d1bf0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:09.661243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.662301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.662597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.664885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:09.665135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:09.673262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:09.706538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.707406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.707913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.713218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 919/1812] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:09.715420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:09.734975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f5ba3-23e5-4ebc-8892-29098256a74b tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:09.745324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210d80a703784d0fa3a2cb84fdcac70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f9173e79c944ff9a8767f5181d1bf0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:09.746463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.747493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.748598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.750405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:09.755988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:09.772774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:09.800086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] MFA Rules not processed for user `de343953c3f24a4fbf8277edb098f165`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:09.802742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:09.826821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 920/1813] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:09 2022] POST /identity/v3/projects => generated 354 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:23:09.828892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:09.940465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 894/1814] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:09.941545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167716e-d864-4ca5-a55b-27bbfc0df396 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:09.947260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210d80a703784d0fa3a2cb84fdcac70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f9173e79c944ff9a8767f5181d1bf0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:09.948003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.948345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.948720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.952784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:09.953504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:09.955486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:09.973089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 921/1815] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:10.022767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:10.041360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba9a76-bb84-41dd-88d2-005527c213c8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:10.063781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '210d80a703784d0fa3a2cb84fdcac70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73f9173e79c944ff9a8767f5181d1bf0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:10.064677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:10.064964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:10.065238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] PATH_INFO: `/v3/projects/addddcf6354f4094ad3551c50f761f38` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:10.068886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorizing `identity:delete_project(project_id=addddcf6354f4094ad3551c50f761f38)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:10.071289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:10.139569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addddcf6354f4094ad3551c50f761f38', 'request_id': 'req-618cb616-587b-4400-9411-25c93157e6fe'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:10.151543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addddcf6354f4094ad3551c50f761f38', 'request_id': 'req-618cb616-587b-4400-9411-25c93157e6fe'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:10.164261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addddcf6354f4094ad3551c50f761f38', 'request_id': 'req-618cb616-587b-4400-9411-25c93157e6fe'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:10.221182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] The token cache is being invalidate because project addddcf6354f4094ad3551c50f761f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:10.221551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:10.222313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:10.230369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 895/1816] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:10 2022] DELETE /identity/v3/projects/addddcf6354f4094ad3551c50f761f38 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:10.364270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:10.366663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:10.558055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16e13-9bbf-4b40-a024-c9e3ce6ef6d8 tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:10.808872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:10.811832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:10.813203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:10.813629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] PATH_INFO: `/v3/projects/ae9ed8bab6be49a7939fb75097b37235` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:10.819896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:10.822165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9ed8bab6be49a7939fb75097b37235)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:10.822339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:10.839527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:10.852362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cb616-587b-4400-9411-25c93157e6fe tempest-VolumeQuotaClassesTest-1602115865 tempest-VolumeQuotaClassesTest-1602115865-project-admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:10.864043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:10.865092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:10.865553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:10.866018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] PATH_INFO: `/v3/users/e272c7da3dde435eb4588e9e1fa232ab` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:10.873209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e272c7da3dde435eb4588e9e1fa232ab)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:10.875457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:11.003051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:11.048764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e272c7da3dde435eb4588e9e1fa232ab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.070948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9ed8bab6be49a7939fb75097b37235', 'request_id': 'req-b7f1e66d-8918-461d-95ec-757baa30ff4f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.073999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e272c7da3dde435eb4588e9e1fa232ab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.076765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e272c7da3dde435eb4588e9e1fa232ab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.098775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9ed8bab6be49a7939fb75097b37235', 'request_id': 'req-b7f1e66d-8918-461d-95ec-757baa30ff4f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.114888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:11.124220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e272c7da3dde435eb4588e9e1fa232ab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.143180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-835af7e2-64e6-40f3-ae5e-98eea74aae67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e272c7da3dde435eb4588e9e1fa232ab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.154133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 896/1817] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:10 2022] DELETE /identity/v3/users/e272c7da3dde435eb4588e9e1fa232ab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:11.154996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9ed8bab6be49a7939fb75097b37235', 'request_id': 'req-b7f1e66d-8918-461d-95ec-757baa30ff4f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.165265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:11.165881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:11.166647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:11.192879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] The token cache is being invalidate because project ae9ed8bab6be49a7939fb75097b37235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:11.193259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.194078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.195968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 922/1818] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:10 2022] DELETE /identity/v3/projects/ae9ed8bab6be49a7939fb75097b37235 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:11.199833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:11.201508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:11.203120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:11.205859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:11.365647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 897/1819] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:11.371423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e66d-8918-461d-95ec-757baa30ff4f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:11.385107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:11.387181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:11.388557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:11.389532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:11.390087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:11.390498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] PATH_INFO: `/v3/users/8a239847cc9f4613877d23f6388dd8b1` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:11.394931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a239847cc9f4613877d23f6388dd8b1)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:11.397334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:11.586911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a239847cc9f4613877d23f6388dd8b1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.588337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a239847cc9f4613877d23f6388dd8b1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.607196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a239847cc9f4613877d23f6388dd8b1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.633908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91593567-3a93-432c-916a-f8cf96850e9e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:11.642868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:11.644007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:11.644493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:11.644974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:11.680342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:11.682510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:11.701938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a239847cc9f4613877d23f6388dd8b1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.707114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 898/1820] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:11.726336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a239847cc9f4613877d23f6388dd8b1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:11.758140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 923/1821] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:11 2022] DELETE /identity/v3/users/8a239847cc9f4613877d23f6388dd8b1 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:12.996045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:13.017331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9dcc-9f8f-47ee-bdba-251b50fe4630 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:13.029260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:13.044237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:13.162615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:13.164289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:13.164860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:13.166592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] PATH_INFO: `/v3/projects/db3a41c497d14751ac2f79212af2ab0f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:13.169899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3a41c497d14751ac2f79212af2ab0f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:13.176692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:13.185533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:13.258880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:13.260642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b677-9257-4b07-b908-3ddff631d3c6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:13.289511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3a41c497d14751ac2f79212af2ab0f', 'request_id': 'req-48b0fd1d-8334-4eb7-8602-ae53af247b54'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.298315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3a41c497d14751ac2f79212af2ab0f', 'request_id': 'req-48b0fd1d-8334-4eb7-8602-ae53af247b54'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.307087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3a41c497d14751ac2f79212af2ab0f', 'request_id': 'req-48b0fd1d-8334-4eb7-8602-ae53af247b54'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.327433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] The token cache is being invalidate because project db3a41c497d14751ac2f79212af2ab0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:13.327894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.329222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.331675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 899/1822] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:12 2022] DELETE /identity/v3/projects/db3a41c497d14751ac2f79212af2ab0f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:13.336176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:13.339489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:13.379801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:13.381270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:13.381270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:13.381270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] PATH_INFO: `/v3/projects/cf02223180454d92bbbf30269c63abf9` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:13.382647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf02223180454d92bbbf30269c63abf9)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:13.384870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:13.439097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf02223180454d92bbbf30269c63abf9', 'request_id': 'req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.446080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf02223180454d92bbbf30269c63abf9', 'request_id': 'req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.448060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0fd1d-8334-4eb7-8602-ae53af247b54 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:13.456780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf02223180454d92bbbf30269c63abf9', 'request_id': 'req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.469580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] The token cache is being invalidate because project cf02223180454d92bbbf30269c63abf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:13.470114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.470688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.472529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 924/1823] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:13 2022] DELETE /identity/v3/projects/cf02223180454d92bbbf30269c63abf9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:13.476512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:13.479171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:13.567302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:13.568236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:13.568822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:13.569166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] PATH_INFO: `/v3/users/db23ca2108f64076a0a9209ac487b47e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:13.570788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db23ca2108f64076a0a9209ac487b47e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:13.573085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:13.586070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207ca6-b2f8-438b-a3b7-9d2fe9505437 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:13.591460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:13.592277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:13.592566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:13.592949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] PATH_INFO: `/v3/users/210d80a703784d0fa3a2cb84fdcac70e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:13.596039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=210d80a703784d0fa3a2cb84fdcac70e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:13.599968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:13.626239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:13.650263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db23ca2108f64076a0a9209ac487b47e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.661859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db23ca2108f64076a0a9209ac487b47e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.663019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db23ca2108f64076a0a9209ac487b47e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.685240 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:13.686269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210d80a703784d0fa3a2cb84fdcac70e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.687234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210d80a703784d0fa3a2cb84fdcac70e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.687806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db23ca2108f64076a0a9209ac487b47e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.704232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db23ca2108f64076a0a9209ac487b47e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.704458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210d80a703784d0fa3a2cb84fdcac70e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.717396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 900/1824] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:13 2022] DELETE /identity/v3/users/db23ca2108f64076a0a9209ac487b47e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:13.726871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210d80a703784d0fa3a2cb84fdcac70e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.736058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210d80a703784d0fa3a2cb84fdcac70e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:13.743625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 925/1825] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:13 2022] DELETE /identity/v3/users/210d80a703784d0fa3a2cb84fdcac70e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:14.107385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:14.109086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.162599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:14.164989 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.284071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79167e-e7fe-41c6-8ad0-e4e22cb4aa6b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:14.289581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:14.290631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.290904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.291179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] PATH_INFO: `/v3/projects/dbe42021a2114dcdbeb7bf1612e4b736` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.292407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe42021a2114dcdbeb7bf1612e4b736)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:14.295584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:14.297222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a021-e9b1-41de-96b6-a99620fcf787 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:14.303626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:14.304296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.304575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.304904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] PATH_INFO: `/v3/users/70dbf209ca604edebf655581a74841ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.306114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70dbf209ca604edebf655581a74841ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:14.308107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:14.387654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe42021a2114dcdbeb7bf1612e4b736', 'request_id': 'req-ef51a01e-2fab-42cd-95b5-8541d6b3953d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.403677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70dbf209ca604edebf655581a74841ae'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.417449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70dbf209ca604edebf655581a74841ae'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.418747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70dbf209ca604edebf655581a74841ae'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.423216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe42021a2114dcdbeb7bf1612e4b736', 'request_id': 'req-ef51a01e-2fab-42cd-95b5-8541d6b3953d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.443520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70dbf209ca604edebf655581a74841ae'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.444916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe42021a2114dcdbeb7bf1612e4b736', 'request_id': 'req-ef51a01e-2fab-42cd-95b5-8541d6b3953d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.457350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5a5da338-ce9b-4bfe-af7c-119a92b5ce64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70dbf209ca604edebf655581a74841ae'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.463871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] The token cache is being invalidate because project dbe42021a2114dcdbeb7bf1612e4b736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:14.465413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.466495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.469858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 926/1826] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:14 2022] DELETE /identity/v3/projects/dbe42021a2114dcdbeb7bf1612e4b736 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:14.472969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 901/1827] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:14 2022] DELETE /identity/v3/users/70dbf209ca604edebf655581a74841ae => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:14.473100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:14.476203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.476643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6f40-100e-4da6-a60f-4761ce2e1958 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.477262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6f40-100e-4da6-a60f-4761ce2e1958 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.477962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6f40-100e-4da6-a60f-4761ce2e1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.514165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-426c6f40-100e-4da6-a60f-4761ce2e1958 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:14.519291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-426c6f40-100e-4da6-a60f-4761ce2e1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.526923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:14.634829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 902/1828] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:14.634829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.634829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.634829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.643797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51a01e-2fab-42cd-95b5-8541d6b3953d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:14.649331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:14.651249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:14.651986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.652373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.652615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] PATH_INFO: `/v3/projects/73f9173e79c944ff9a8767f5181d1bf0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.653916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f9173e79c944ff9a8767f5181d1bf0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:14.655889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:14.667619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:14.670395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.686568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 903/1829] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:14.690601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:14.695126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.721328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f9173e79c944ff9a8767f5181d1bf0', 'request_id': 'req-6e7f939d-164e-4798-8ce6-37c1e280dc41'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.730184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f9173e79c944ff9a8767f5181d1bf0', 'request_id': 'req-6e7f939d-164e-4798-8ce6-37c1e280dc41'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.747381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f9173e79c944ff9a8767f5181d1bf0', 'request_id': 'req-6e7f939d-164e-4798-8ce6-37c1e280dc41'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.771506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] The token cache is being invalidate because project 73f9173e79c944ff9a8767f5181d1bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:14.771988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.773160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6e7f939d-164e-4798-8ce6-37c1e280dc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:14.777026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 927/1830] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:14 2022] DELETE /identity/v3/projects/73f9173e79c944ff9a8767f5181d1bf0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:14.779013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b16a-e4b2-4b8f-82a5-f6ed1d653c56 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.779287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b16a-e4b2-4b8f-82a5-f6ed1d653c56 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.779553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b16a-e4b2-4b8f-82a5-f6ed1d653c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.799067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a5c74-e82f-45d1-833c-d547778e7759 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:14.809443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-75f9b16a-e4b2-4b8f-82a5-f6ed1d653c56 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:14.810726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-75f9b16a-e4b2-4b8f-82a5-f6ed1d653c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.887447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:14.888098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.888418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.888724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.890965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.908957 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 928/1831] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:14.912149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.912704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.913120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.953874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:14.956481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:14.970205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 929/1832] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:14.978867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:14.989224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:14.990465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8668e-2079-46d1-bceb-4f8f956648d5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:14.991387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e5984-52be-4313-b098-7b8a22c118cc service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:14.996269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:14.997196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:14.997572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:14.998520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:14.999211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:14.999627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.001863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.010130 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 904/1833] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:15.012511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.012963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.013358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.025446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 930/1834] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:15.030391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.051342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3983ac1-53df-47be-82f9-f4fec6fb65fa admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.054363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:15.056609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.057318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.057599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.057906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.058043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:15.058505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.060834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.078766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 905/1835] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:15.083693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.095394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cda97-8e37-41e6-86f0-625f32d97e32 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.103183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.103848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.104155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.104857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.105635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:15.105942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.108235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.126816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 931/1836] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:15.128711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.137438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 906/1837] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:15.138632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.151974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d83745-c371-463b-b9dd-923f8ce8c20e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.163228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:15.221948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:15.241886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.242707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.243096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.243466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.244262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.246641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.285725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 907/1838] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:15.291950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.297466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f125b55-6905-4481-86af-ff8804b99f28 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.386037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35e95-73b9-4b2a-932c-28d123b0c4c4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.394966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.395781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.396189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.396575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.397395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.399768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.453602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 908/1839] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:23:15.457891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.474353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4638726-23a6-4170-826c-82d2c769f7da admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.475428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.478248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.479001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.479626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.481019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.481818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.482645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.483064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.483477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.484404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.486138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.488066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.503391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 909/1840] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:15.509586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.525661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12913281-cf1d-4a5b-8f9b-dae8f438d1d3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.533188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.533831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.534103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.534825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.535546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.537290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.540137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 932/1841] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/users => generated 284 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:15.546492 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.564760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 910/1842] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:15.566120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.573310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a177ce-537e-4848-9a23-6cf52c507557 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.582838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.584020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.584582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.585202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.586536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.587826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58aa2d-83ea-4428-8a63-92f5f0457d3a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.590848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.594323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca93ac-83ff-41ae-b6e1-928ea0823250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.595748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca93ac-83ff-41ae-b6e1-928ea0823250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.596395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca93ac-83ff-41ae-b6e1-928ea0823250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.596892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca93ac-83ff-41ae-b6e1-928ea0823250 admin admin] PATH_INFO: `/v3/projects/5780d49035fd426c9e260b9e5f35da98/users/e2950a8921894076b25afb9b0b4cd4a7/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.618453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 933/1843] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:15.621015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.634364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca93ac-83ff-41ae-b6e1-928ea0823250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5780d49035fd426c9e260b9e5f35da98, user_id=e2950a8921894076b25afb9b0b4cd4a7, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.639749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca93ac-83ff-41ae-b6e1-928ea0823250 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.647398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344e92-0542-4a7a-979c-0550e99d087d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.654323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.654964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.655240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.655561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.656264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.658661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.675433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 911/1844] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:15 2022] PUT /identity/v3/projects/5780d49035fd426c9e260b9e5f35da98/users/e2950a8921894076b25afb9b0b4cd4a7/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:15.699814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.699814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.711614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.740608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 934/1845] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:15.742644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.795674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa634a-e766-4f09-952b-1806a65facdc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.833461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] MFA Rules not processed for user `e2950a8921894076b25afb9b0b4cd4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:15.836670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:16.030375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 912/1846] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:16.034206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.037888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:16.071760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.073653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.074256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.074829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] PATH_INFO: `/v3/projects/3a9a369c74b9440da5bffd2eef7396ad/users/2ce5e171fce949228b50eb70c3901595/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.091294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:16.130802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9a369c74b9440da5bffd2eef7396ad, user_id=2ce5e171fce949228b50eb70c3901595, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:16.134084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:16.169873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 935/1847] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:15 2022] PUT /identity/v3/projects/3a9a369c74b9440da5bffd2eef7396ad/users/2ce5e171fce949228b50eb70c3901595/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:16.171030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.228887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:16.277552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79c20-112e-44ac-b2dd-2bcaf489a1f1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.343323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d86fae-67ba-478a-9784-e31c5a7b9947 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.350307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8089d-a65c-4b0a-9b00-4408a349c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.351105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8089d-a65c-4b0a-9b00-4408a349c124 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.351482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8089d-a65c-4b0a-9b00-4408a349c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.351845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8089d-a65c-4b0a-9b00-4408a349c124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.352608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8089d-a65c-4b0a-9b00-4408a349c124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:16.355412 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8089d-a65c-4b0a-9b00-4408a349c124 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:16.395259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 936/1848] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:16 2022] POST /identity/v3/projects => generated 391 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:16.400614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.401141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.401512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.472097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.472996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.474027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.476293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] PATH_INFO: `/v3/projects/a01b791c096f475fa2e3249b43a4a6e0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.479099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01b791c096f475fa2e3249b43a4a6e0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:16.485742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:16.540942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] MFA Rules not processed for user `2ce5e171fce949228b50eb70c3901595`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:16.544421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:16.701614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01b791c096f475fa2e3249b43a4a6e0', 'request_id': 'req-40712af3-47ee-45a5-b5d6-0d91fd48776e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:16.734614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01b791c096f475fa2e3249b43a4a6e0', 'request_id': 'req-40712af3-47ee-45a5-b5d6-0d91fd48776e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:16.750836 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01b791c096f475fa2e3249b43a4a6e0', 'request_id': 'req-40712af3-47ee-45a5-b5d6-0d91fd48776e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:16.774594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 937/1849] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:16.776093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.796592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] The token cache is being invalidate because project a01b791c096f475fa2e3249b43a4a6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:16.796933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:16.800670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:16.804295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 913/1850] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:16 2022] DELETE /identity/v3/projects/a01b791c096f475fa2e3249b43a4a6e0 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:16.808118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.809632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:16.900326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:16.911285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0d11-0b85-41b0-8be1-c926ba244805 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.932707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712af3-47ee-45a5-b5d6-0d91fd48776e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.941297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.942113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.942953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.944044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.946499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:16.959751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:17.039869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:17.055947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.056374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.056778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.058849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.062858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.072569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.076018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.111727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 914/1851] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:17.116102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:17.121552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:17.156698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 938/1852] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:16 2022] POST /identity/v3/users => generated 302 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:17.160982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:17.164825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:17.196295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee182-eaee-466a-95f3-d027a3a4d893 service glance] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:17.210531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e95fd-321b-4dee-b2b8-d7089073136e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:17.219286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:17.220814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.221497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.222204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] PATH_INFO: `/v3/users/66a378323e5b4897a3806e2692c11b1e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.222384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:17.223000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.225875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a378323e5b4897a3806e2692c11b1e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.226141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.226330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.227193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.228943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.240323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.241196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 939/1853] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:17.248365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:17.270056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e83219-8a1d-4891-a5c6-31bbe26168bb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:17.299295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:17.300096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.300376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.300660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] PATH_INFO: `/v3/projects/4e014bb0a67344cbb3a11d4f58dd8707/users/454bdb7ae9e1479c84acca248aa1f26a/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.332660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e014bb0a67344cbb3a11d4f58dd8707, user_id=454bdb7ae9e1479c84acca248aa1f26a, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.332660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.386511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 940/1854] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:17 2022] PUT /identity/v3/projects/4e014bb0a67344cbb3a11d4f58dd8707/users/454bdb7ae9e1479c84acca248aa1f26a/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:17.388354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a378323e5b4897a3806e2692c11b1e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:17.392538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:17.415823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a378323e5b4897a3806e2692c11b1e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:17.417202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a378323e5b4897a3806e2692c11b1e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:17.477038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a378323e5b4897a3806e2692c11b1e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:17.507909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a378323e5b4897a3806e2692c11b1e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:17.525868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8f127-a49f-4777-a2ac-8aec3441cbd0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:17.529232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 915/1855] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:17 2022] DELETE /identity/v3/users/66a378323e5b4897a3806e2692c11b1e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:17.695912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb380-646c-4495-a7c9-65cf42bd81ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:17.696647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb380-646c-4495-a7c9-65cf42bd81ab admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.696930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb380-646c-4495-a7c9-65cf42bd81ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.697195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb380-646c-4495-a7c9-65cf42bd81ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.697862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb380-646c-4495-a7c9-65cf42bd81ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.699633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb380-646c-4495-a7c9-65cf42bd81ab admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.738561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 941/1856] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:17.747495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:17.750118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:17.820318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6b9b-393e-4871-9332-3dc1fc717fb3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:17.856190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45514-5c59-4a9c-a48d-21e91374134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:17.857314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45514-5c59-4a9c-a48d-21e91374134b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.857788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45514-5c59-4a9c-a48d-21e91374134b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.860957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45514-5c59-4a9c-a48d-21e91374134b admin admin] PATH_INFO: `/v3/projects/4e014bb0a67344cbb3a11d4f58dd8707/users/454bdb7ae9e1479c84acca248aa1f26a/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.878904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45514-5c59-4a9c-a48d-21e91374134b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e014bb0a67344cbb3a11d4f58dd8707, user_id=454bdb7ae9e1479c84acca248aa1f26a, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.886796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6edf53-1d8e-49e1-ac54-a67e111495e4 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.887103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6edf53-1d8e-49e1-ac54-a67e111495e4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.887332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6edf53-1d8e-49e1-ac54-a67e111495e4 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.889010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 942/1857] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:23:17.890630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45514-5c59-4a9c-a48d-21e91374134b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.926696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.927028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.927229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.968745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:17.970443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:17.980673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 916/1858] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:17 2022] PUT /identity/v3/projects/4e014bb0a67344cbb3a11d4f58dd8707/users/454bdb7ae9e1479c84acca248aa1f26a/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:18.000494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:18.000798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:18.001443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:18.043196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:18.062983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] MFA Rules not processed for user `454bdb7ae9e1479c84acca248aa1f26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:18.065660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:18.205018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 943/1859] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:23:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:23:18.244213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:18.343171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 917/1860] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:18.361725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:18.365543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:18.554604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad806e-de81-4956-a1f1-fe1c69192c87 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:18.561517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:18.563400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:18.564297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:18.564955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:18.606295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:18.609366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:18.629693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 944/1861] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:18.764276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:18.768323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:18.789186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ae9c6-6b6b-414c-a311-facfd53be3bc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:18.796208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:18.797172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:18.797834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:18.798429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:18.802531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:18.982020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:18.983986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:19.007548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 918/1862] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:19.470987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:19.477090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:19.527896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f150ae0-610c-464d-8991-d50e0494e960 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:19.544435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32d0d3-670e-4490-ba6d-9ccbcf9866ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:19.545350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32d0d3-670e-4490-ba6d-9ccbcf9866ce service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:19.545678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32d0d3-670e-4490-ba6d-9ccbcf9866ce service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:19.545956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32d0d3-670e-4490-ba6d-9ccbcf9866ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:19.576416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32d0d3-670e-4490-ba6d-9ccbcf9866ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:19.578677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32d0d3-670e-4490-ba6d-9ccbcf9866ce service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:19.621264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 945/1863] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:19.912544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:19.914793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:20.022911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9b7c-ab69-455c-a360-16fb2d05bfba service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:20.031084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:20.037927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.037927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.037927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] PATH_INFO: `/v3/projects/1b4f7df8a877409b8c9c47b645235bff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.039495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4f7df8a877409b8c9c47b645235bff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:20.043164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:20.186267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4f7df8a877409b8c9c47b645235bff', 'request_id': 'req-0e1a50c9-367d-4af5-9b84-b6d2659c8534'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:20.197781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4f7df8a877409b8c9c47b645235bff', 'request_id': 'req-0e1a50c9-367d-4af5-9b84-b6d2659c8534'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:20.207628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4f7df8a877409b8c9c47b645235bff', 'request_id': 'req-0e1a50c9-367d-4af5-9b84-b6d2659c8534'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:20.229695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] The token cache is being invalidate because project 1b4f7df8a877409b8c9c47b645235bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:20.230108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:20.231749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0e1a50c9-367d-4af5-9b84-b6d2659c8534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:20.238307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 919/1864] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:19 2022] DELETE /identity/v3/projects/1b4f7df8a877409b8c9c47b645235bff => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:20.241450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.242202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.243241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.301797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:20.303131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:20.426361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 946/1865] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:20.439292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.439562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.439846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.457869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:20.465413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:20.468695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:20.486189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 920/1866] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:20.491068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:20.510583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deca1d-7d45-47e2-ab1c-d23c912c30c0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:20.525593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:20.527436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.531222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.531807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.532872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:20.533431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:20.535330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:20.557098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 947/1867] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:20.565140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:20.583829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d70273-ccaf-4080-8257-14f114b8dfda None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:20.591058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:20.592271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.592869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.593309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.594456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:20.598528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:20.678543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 921/1868] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:20 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:20.680694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:20.694731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb203a4-80df-4366-9172-6ec0c184314f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:20.760084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:20.876605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:20.878425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.878890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.879338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.880539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:20.890035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:20.953921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 948/1869] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:20 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:20.958680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:20.981775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b8a45-889f-4b1a-b2c3-b971510b09c3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:20.995877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:20.997344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.998563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.999039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:21.002778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:21.006446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:21.049982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 922/1870] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:21.051520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:21.063815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c2a6-6f94-42fe-81cb-985ab77336c0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:21.071469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a022b-b966-474f-b8a9-23a2e8fce806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:21.075954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a022b-b966-474f-b8a9-23a2e8fce806 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:21.076478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a022b-b966-474f-b8a9-23a2e8fce806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:21.076956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a022b-b966-474f-b8a9-23a2e8fce806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:21.078590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a022b-b966-474f-b8a9-23a2e8fce806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:21.088612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a022b-b966-474f-b8a9-23a2e8fce806 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:21.113681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 949/1871] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:21.118173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:21.136563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14c102-9a49-488c-8811-c38c0d9cf3c1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:21.143678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:21.145484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:21.146104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:21.146682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] PATH_INFO: `/v3/projects/d8410be155ae482c987dfeda4e5fb557/users/bf87a279a3964cee8edb7989f72a3a67/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:21.189084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8410be155ae482c987dfeda4e5fb557, user_id=bf87a279a3964cee8edb7989f72a3a67, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:21.210175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:21.235002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 923/1872] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:21 2022] PUT /identity/v3/projects/d8410be155ae482c987dfeda4e5fb557/users/bf87a279a3964cee8edb7989f72a3a67/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:21.241931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:21.242218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:21.242488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:21.271999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:21.273579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:21.389881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 950/1873] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:21.404830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:21.408149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:21.570341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244de15-1d16-4271-b7be-5eb64c8ae799 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:21.580745 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e004f-ac42-4fee-bc26-ccfb346a0843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:21.582284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e004f-ac42-4fee-bc26-ccfb346a0843 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:21.582841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e004f-ac42-4fee-bc26-ccfb346a0843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:21.583351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e004f-ac42-4fee-bc26-ccfb346a0843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:21.618932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e004f-ac42-4fee-bc26-ccfb346a0843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:21.627467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e004f-ac42-4fee-bc26-ccfb346a0843 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:21.664704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 924/1874] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:24.202679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:24.204740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:24.220321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3080228-7156-438f-a0b0-95e35b0d1cc6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:24.226368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:24.227036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:24.227486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:24.227748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] PATH_INFO: `/v3/users/e2950a8921894076b25afb9b0b4cd4a7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:24.229344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2950a8921894076b25afb9b0b4cd4a7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:24.231655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:24.334021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2950a8921894076b25afb9b0b4cd4a7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:24.335823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2950a8921894076b25afb9b0b4cd4a7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:24.373849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2950a8921894076b25afb9b0b4cd4a7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:24.395763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2950a8921894076b25afb9b0b4cd4a7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:24.406832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2950a8921894076b25afb9b0b4cd4a7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:24.415103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 951/1875] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:24 2022] DELETE /identity/v3/users/e2950a8921894076b25afb9b0b4cd4a7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:24.422487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84775ea-c5c4-442b-9baf-34782e46dc49 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:24.423317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84775ea-c5c4-442b-9baf-34782e46dc49 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:24.423453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84775ea-c5c4-442b-9baf-34782e46dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:24.454855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e84775ea-c5c4-442b-9baf-34782e46dc49 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:24.456415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e84775ea-c5c4-442b-9baf-34782e46dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:24.652821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 925/1876] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:24.723224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:24.726940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:24.819038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:24.878754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aee8f-2777-4c70-bb50-995a3e447fd2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:24.884129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:24.885288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:24.885821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:24.886327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:24.902858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:24.906457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:24.927520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:24.927520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:24.927520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:24.936347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 952/1877] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:25.004687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] MFA Rules not processed for user `bf87a279a3964cee8edb7989f72a3a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:25.006855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:25.073885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:25.168185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.169857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:25.172686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 926/1878] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:25.196155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b118bd1-3bf8-4ef7-999c-cbabad3b9dd6 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.213718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.213718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.214697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.214697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.215087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.217332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:25.289829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 953/1879] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:25 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:25.302896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.321993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299f7b-13ce-424f-8feb-341d6584b17f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.480867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.482385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.483013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.483495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.484414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.486870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:25.518090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 927/1880] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:25 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:23:25.524298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.568488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e623333-2cbb-49ec-9af7-d17c85cb68db admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.591530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.593011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.593213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.595076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.597541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.600650 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:25.643872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 954/1881] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:25.650389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.663386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82544bf-0750-4ad8-b3d4-795c8574b5a5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.669937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.670837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.671236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.671624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] PATH_INFO: `/v3/projects/8be8ff49362a4bdb8835589f8332ea57/users/120cd822e0a445cd814bc8fc444b0a83/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.696691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be8ff49362a4bdb8835589f8332ea57, user_id=120cd822e0a445cd814bc8fc444b0a83, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.700340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:25.721176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 928/1882] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:25 2022] PUT /identity/v3/projects/8be8ff49362a4bdb8835589f8332ea57/users/120cd822e0a445cd814bc8fc444b0a83/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:25.725528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.738615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651918-4a7b-458f-bd15-4ed1565f0957 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.826629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.826629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.826629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.826629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.827326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.828773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:25.842017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 955/1883] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:25.847239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.863901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4251-b518-4fce-8888-432f454b3cb8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.865385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:25.867906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:25.869820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.870630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.871001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.871365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] PATH_INFO: `/v3/projects/8be8ff49362a4bdb8835589f8332ea57/users/120cd822e0a445cd814bc8fc444b0a83/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.874519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be8ff49362a4bdb8835589f8332ea57, user_id=120cd822e0a445cd814bc8fc444b0a83, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.877728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:25.883402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87a20-f1e7-4a17-9a2e-770561ebc1bd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:25.894034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:25.894925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:25.895575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:25.896027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] PATH_INFO: `/v3/projects/5780d49035fd426c9e260b9e5f35da98` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:25.897937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5780d49035fd426c9e260b9e5f35da98)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:25.902503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 929/1884] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:25 2022] PUT /identity/v3/projects/8be8ff49362a4bdb8835589f8332ea57/users/120cd822e0a445cd814bc8fc444b0a83/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:25.909571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:26.039509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5780d49035fd426c9e260b9e5f35da98', 'request_id': 'req-7742775f-206b-482c-bfec-5b656c828dce'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.063737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5780d49035fd426c9e260b9e5f35da98', 'request_id': 'req-7742775f-206b-482c-bfec-5b656c828dce'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.078650 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5780d49035fd426c9e260b9e5f35da98', 'request_id': 'req-7742775f-206b-482c-bfec-5b656c828dce'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.100663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] The token cache is being invalidate because project 5780d49035fd426c9e260b9e5f35da98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:26.100663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.102026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.107468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 956/1885] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:25 2022] DELETE /identity/v3/projects/5780d49035fd426c9e260b9e5f35da98 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:26.110658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:26.113292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:26.278842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91961332-d81c-4797-9a8d-9a4e863de498 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:26.371477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:26.441873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:26.443330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:26.444113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:26.445297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] PATH_INFO: `/v3/users/454bdb7ae9e1479c84acca248aa1f26a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:26.448391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454bdb7ae9e1479c84acca248aa1f26a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:26.452254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:26.581946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454bdb7ae9e1479c84acca248aa1f26a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.616695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454bdb7ae9e1479c84acca248aa1f26a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.616695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454bdb7ae9e1479c84acca248aa1f26a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.635894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454bdb7ae9e1479c84acca248aa1f26a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.679311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c7ef41f9-ec4d-4d4e-854e-aae6a95f2ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454bdb7ae9e1479c84acca248aa1f26a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:26.704316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 930/1886] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:26 2022] DELETE /identity/v3/users/454bdb7ae9e1479c84acca248aa1f26a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:27.457095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:27.476046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742775f-206b-482c-bfec-5b656c828dce admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:27.518173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:27.603933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:27.605298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:27.605831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:27.606208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] PATH_INFO: `/v3/projects/4e014bb0a67344cbb3a11d4f58dd8707` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:27.609220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e014bb0a67344cbb3a11d4f58dd8707)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:27.617616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:27.735004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d39f9-27f7-439d-a4fc-b0ed8242e4fb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:27.736488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d39f9-27f7-439d-a4fc-b0ed8242e4fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:27.737271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d39f9-27f7-439d-a4fc-b0ed8242e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:27.771847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e014bb0a67344cbb3a11d4f58dd8707', 'request_id': 'req-8e2738c1-6e46-4901-8354-394afbd36e40'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:27.788691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e014bb0a67344cbb3a11d4f58dd8707', 'request_id': 'req-8e2738c1-6e46-4901-8354-394afbd36e40'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:27.800695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e014bb0a67344cbb3a11d4f58dd8707', 'request_id': 'req-8e2738c1-6e46-4901-8354-394afbd36e40'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:27.818087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] The token cache is being invalidate because project 4e014bb0a67344cbb3a11d4f58dd8707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:27.824374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:27.824374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e2738c1-6e46-4901-8354-394afbd36e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:27.825590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 957/1887] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:27 2022] DELETE /identity/v3/projects/4e014bb0a67344cbb3a11d4f58dd8707 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:27.827620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d32ec-dcc5-4dce-aa91-a15ce89d700d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:27.828076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d32ec-dcc5-4dce-aa91-a15ce89d700d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:27.828546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d32ec-dcc5-4dce-aa91-a15ce89d700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:27.856240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-df2d32ec-dcc5-4dce-aa91-a15ce89d700d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:27.857762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-df2d32ec-dcc5-4dce-aa91-a15ce89d700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:27.859698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c42d39f9-27f7-439d-a4fc-b0ed8242e4fb None None] MFA Rules not processed for user `120cd822e0a445cd814bc8fc444b0a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:27.865162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c42d39f9-27f7-439d-a4fc-b0ed8242e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:27.970205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 958/1888] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:27.972036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:27.972323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:27.972596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.015394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:28.022921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:28.069386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 959/1889] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:28.074226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.100219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 931/1890] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:28.102021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758308d0-ce6b-4de9-a8a6-dc86aa5a837d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.107763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.108404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.108798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.109608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.110434 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:28.110742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.112906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.124370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.125314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.125314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.135934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 960/1891] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:28.148107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.167967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f7001-8e25-499d-bf87-4a95203ab6fb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.173367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] MFA Rules not processed for user `bf87a279a3964cee8edb7989f72a3a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:28.183456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:28.185285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.186927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.187953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.188332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.189188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.191476 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.290824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:28.304694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 961/1892] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:28 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:28.309938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.334800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:28.349909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 932/1893] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:28.465986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d97a0-6bbd-45a1-845b-116ca1000a3a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.495568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.495568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.495568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.495568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.496189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.496189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.496456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.509360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:28.556863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 962/1894] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:28 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:28.563623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.575524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521982-1335-410e-af11-f51d1b502c43 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.587738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.588916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.590265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.590265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.590265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.593405 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.605422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 963/1895] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:28.610338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.621022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f01b10-c89f-4649-aac9-f038589cb726 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.624605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea06be-121d-4bc1-9657-af7e8292c09a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.626838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.627499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.627749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.628020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.628693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.630578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.643445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 964/1896] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:28.647798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.663813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63aaa-c522-4308-a0b7-0246a62007a1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:28.685582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bc5ed-d1d1-4dde-8363-f302f6622f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.686279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc5ed-d1d1-4dde-8363-f302f6622f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.686555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc5ed-d1d1-4dde-8363-f302f6622f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.687012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc5ed-d1d1-4dde-8363-f302f6622f75 admin admin] PATH_INFO: `/v3/projects/97563a3b494e483a8110e551e67f2ce5/users/19aca048021d4ad7b13250a217f65cee/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.719110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bc5ed-d1d1-4dde-8363-f302f6622f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97563a3b494e483a8110e551e67f2ce5, user_id=19aca048021d4ad7b13250a217f65cee, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.724547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bc5ed-d1d1-4dde-8363-f302f6622f75 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.728458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:28.729141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.729424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.729702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.731588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:28.752991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 965/1897] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:28 2022] PUT /identity/v3/projects/97563a3b494e483a8110e551e67f2ce5/users/19aca048021d4ad7b13250a217f65cee/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:28.774528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:28.774528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:28.774896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:28.810470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:28.812997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:28.826946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 933/1898] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:28.830482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] MFA Rules not processed for user `19aca048021d4ad7b13250a217f65cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:28.832944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:28.936303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 966/1899] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:23:28.948402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:28.950026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:28.977629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:29.024923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffad65-7482-47a6-ac16-acb52ecb240a service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:29.146873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b8090-ad00-4a59-8822-ba7d5e1b3b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:29.147545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8090-ad00-4a59-8822-ba7d5e1b3b1e service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:29.148692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8090-ad00-4a59-8822-ba7d5e1b3b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:29.148692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8090-ad00-4a59-8822-ba7d5e1b3b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:29.160576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b8090-ad00-4a59-8822-ba7d5e1b3b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:29.163717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b8090-ad00-4a59-8822-ba7d5e1b3b1e service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:29.178341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 934/1900] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:29.209241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:29.278612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:29.309869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b9633-5b86-46d3-8e5e-b5c6562c04d9 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:29.315869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:29.316604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:29.316932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:29.317216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] PATH_INFO: `/v3/users/19aca048021d4ad7b13250a217f65cee` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:29.318422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19aca048021d4ad7b13250a217f65cee)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:29.320712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:29.389326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19aca048021d4ad7b13250a217f65cee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:29.390591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19aca048021d4ad7b13250a217f65cee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:29.408278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19aca048021d4ad7b13250a217f65cee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:29.433660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19aca048021d4ad7b13250a217f65cee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:29.449911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19aca048021d4ad7b13250a217f65cee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:29.471204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 967/1901] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:29 2022] DELETE /identity/v3/users/19aca048021d4ad7b13250a217f65cee => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:29.473454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:29.473846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:29.474220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:29.505486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:29.507602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:29.614081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 935/1902] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:23:29.626108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:29.629105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:29.742661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0311e-f5ea-459b-b29b-8d37ac3aae28 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:29.748089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cd24c-e940-4088-bfc6-448a7ff1fd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:29.748882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cd24c-e940-4088-bfc6-448a7ff1fd59 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:29.749234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cd24c-e940-4088-bfc6-448a7ff1fd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:29.749722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cd24c-e940-4088-bfc6-448a7ff1fd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:29.765139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cd24c-e940-4088-bfc6-448a7ff1fd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:29.767065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cd24c-e940-4088-bfc6-448a7ff1fd59 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:29.786498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 968/1903] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:23:30.579577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:30.584493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:30.618357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb32d66-0926-4a9c-8be8-d60ce983119d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:30.630259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:30.643026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:30.643335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:30.645301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] PATH_INFO: `/v3/projects/97563a3b494e483a8110e551e67f2ce5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:30.649569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97563a3b494e483a8110e551e67f2ce5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:30.652767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:30.786565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97563a3b494e483a8110e551e67f2ce5', 'request_id': 'req-9def3b63-d99a-4f92-99bd-f8cddb895240'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:30.814183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97563a3b494e483a8110e551e67f2ce5', 'request_id': 'req-9def3b63-d99a-4f92-99bd-f8cddb895240'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:30.855643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97563a3b494e483a8110e551e67f2ce5', 'request_id': 'req-9def3b63-d99a-4f92-99bd-f8cddb895240'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:30.894447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] The token cache is being invalidate because project 97563a3b494e483a8110e551e67f2ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:30.898710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:30.900031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9def3b63-d99a-4f92-99bd-f8cddb895240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:30.904499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 936/1904] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:30 2022] DELETE /identity/v3/projects/97563a3b494e483a8110e551e67f2ce5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:30.911995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:30.912871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:30.912871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:30.965585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:30.967548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:31.154526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.155618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.155915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.165926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 969/1905] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:31.170479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:31.220606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:31.224042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:31.245370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 937/1906] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:23:31.251024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.266931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:31.282448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7edd2-0b77-49c3-a46c-0de6cb8e9575 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:31.297792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:31.300086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.300489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.300893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.301755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:31.306721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:31.308854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:31.353048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 970/1907] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:31.355387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.395385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb309241-f403-4337-82b6-48aa21fa42ae None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:31.416566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:31.418126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.418640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.419717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.425480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:31.431956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:31.500181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 938/1908] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:31 2022] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:31.501090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.529961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804d06-3f8a-4f56-836d-a7fe504fd116 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:31.613969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:31.614926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.615308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.615679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.616451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:31.618651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:31.646166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 971/1909] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:31 2022] POST /identity/v3/users => generated 281 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:31.650314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.661643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd350-60b9-4f02-a95c-ba5c424c5448 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:31.667303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:31.667848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.668119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.668391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.669117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:31.670784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:31.687664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 939/1910] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:31.691770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.702704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24b35-25e4-4bf5-91ef-23b217a492e4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:31.708717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6670-9030-470b-8df1-e95a6355cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:31.709450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6670-9030-470b-8df1-e95a6355cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.710089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6670-9030-470b-8df1-e95a6355cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.710089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6670-9030-470b-8df1-e95a6355cec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.710617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c6670-9030-470b-8df1-e95a6355cec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:31.712506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c6670-9030-470b-8df1-e95a6355cec0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:31.725465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 972/1911] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:31.730543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.742035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad0a4-9906-4d31-9240-abc4ff7fcc0f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:31.748513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:31.749290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.749739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.750197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] PATH_INFO: `/v3/projects/0b1796c52e864dba87281f13c4865835/users/141173b43b984965aac6d0af7b67ddf4/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.770293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1796c52e864dba87281f13c4865835, user_id=141173b43b984965aac6d0af7b67ddf4, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:31.773050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:31.790711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 940/1912] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:31 2022] PUT /identity/v3/projects/0b1796c52e864dba87281f13c4865835/users/141173b43b984965aac6d0af7b67ddf4/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:31.802935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:31.803424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:31.803892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:31.852761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] MFA Rules not processed for user `141173b43b984965aac6d0af7b67ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:31.854032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:31.952482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 973/1913] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:31.992888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:31.995038 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:32.112769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab427274-dd8a-42a7-97cf-45af5ec7b27e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:32.117906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54f1b9-989b-4ba4-9c92-beba71eeb13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:32.118785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f1b9-989b-4ba4-9c92-beba71eeb13f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:32.119126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f1b9-989b-4ba4-9c92-beba71eeb13f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:32.119596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f1b9-989b-4ba4-9c92-beba71eeb13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:32.133368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54f1b9-989b-4ba4-9c92-beba71eeb13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:32.136480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54f1b9-989b-4ba4-9c92-beba71eeb13f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:32.156729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 941/1914] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:32.176270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:32.291394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc960d51-7827-4d7f-a21f-d4889ed9d8d4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:32.296751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:32.299975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:32.300649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:32.301217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] PATH_INFO: `/v3/users/141173b43b984965aac6d0af7b67ddf4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:32.302885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141173b43b984965aac6d0af7b67ddf4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:32.305078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:32.307210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:32.384693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141173b43b984965aac6d0af7b67ddf4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:32.385498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141173b43b984965aac6d0af7b67ddf4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:32.399352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141173b43b984965aac6d0af7b67ddf4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:32.418143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141173b43b984965aac6d0af7b67ddf4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:32.428859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141173b43b984965aac6d0af7b67ddf4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:32.436724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 974/1915] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:32 2022] DELETE /identity/v3/users/141173b43b984965aac6d0af7b67ddf4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:32.441373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:32.441830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:32.442729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:32.477831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:32.479376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:32.568364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 942/1916] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:32.583284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:32.585761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:32.668483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5db29-9b65-4af1-b161-4a85bc954668 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:32.672852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd767d-d9c9-4e90-9294-f22421dbd6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:32.673588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd767d-d9c9-4e90-9294-f22421dbd6da service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:32.674151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd767d-d9c9-4e90-9294-f22421dbd6da service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:32.674398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd767d-d9c9-4e90-9294-f22421dbd6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:32.685437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd767d-d9c9-4e90-9294-f22421dbd6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:32.687546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd767d-d9c9-4e90-9294-f22421dbd6da service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:32.698511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 975/1917] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:33.079959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.081570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:33.101664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326bb8-38c4-493c-a4fc-a6ae3e97cfda None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.109790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.110662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.110983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.111364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] PATH_INFO: `/v3/projects/0b1796c52e864dba87281f13c4865835` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.113616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1796c52e864dba87281f13c4865835)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.126392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.175392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:33.188897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1796c52e864dba87281f13c4865835', 'request_id': 'req-667a8060-c0cb-4731-bd76-012a41fa891b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:33.195758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1796c52e864dba87281f13c4865835', 'request_id': 'req-667a8060-c0cb-4731-bd76-012a41fa891b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:33.203373 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1796c52e864dba87281f13c4865835', 'request_id': 'req-667a8060-c0cb-4731-bd76-012a41fa891b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:33.219187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] The token cache is being invalidate because project 0b1796c52e864dba87281f13c4865835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:33.219509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:33.220200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-667a8060-c0cb-4731-bd76-012a41fa891b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:33.226515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 943/1918] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:33 2022] DELETE /identity/v3/projects/0b1796c52e864dba87281f13c4865835 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:33.228705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.229543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.229543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.263399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:33.265069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:33.382423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 976/1919] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:33.393372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.393856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.394245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.417736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:33.418826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:33.428335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 944/1920] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:33.433190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.446218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa79bc8-c2af-4b5e-ab4a-20b6a714c53c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.452484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.453352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.453627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.453897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.454582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:33.454881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.456505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.469368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 977/1921] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:33.473855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.483736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb91b8-85d5-401e-bf21-a89ae451eeed None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.489013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.489786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.490167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.490500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.491176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.493142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.534665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 945/1922] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:33 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:33.537767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.548983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc6867-786b-42ee-9804-4d25037a4c95 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.556889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:33.627260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.628038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.628315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.628585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.629266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.631230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.659413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 978/1923] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:33 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:33.663824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.687434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde832dd-f11b-4b3b-99c3-96810d883b21 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.699702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.700405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.700748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.701251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.702250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.704285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.715936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 946/1924] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:33.721438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.731244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71ab58-2887-45de-81b0-f62e9e7a87ea admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.736276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb3ca0-b5a0-4917-98fd-6582e4fc32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.736862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb3ca0-b5a0-4917-98fd-6582e4fc32c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.737139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb3ca0-b5a0-4917-98fd-6582e4fc32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.737540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb3ca0-b5a0-4917-98fd-6582e4fc32c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.738190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb3ca0-b5a0-4917-98fd-6582e4fc32c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.739813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb3ca0-b5a0-4917-98fd-6582e4fc32c2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.751603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 979/1925] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:33.757097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:33.768693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba5f7d-c721-4ff4-8cd9-59cd9e0cb52f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:33.776561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:33.777307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.777784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.778207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] PATH_INFO: `/v3/projects/8e05204d1d55427e8e341714dc6837a9/users/560897221f004e36aa47cebe694b9b79/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.804098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e05204d1d55427e8e341714dc6837a9, user_id=560897221f004e36aa47cebe694b9b79, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:33.806825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:33.830754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 947/1926] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:33 2022] PUT /identity/v3/projects/8e05204d1d55427e8e341714dc6837a9/users/560897221f004e36aa47cebe694b9b79/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:33.849673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:33.850153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:33.850641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:33.895600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] MFA Rules not processed for user `560897221f004e36aa47cebe694b9b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:33.896920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:34.057875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 980/1927] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:34.078943 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:34.081066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:34.169174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0c3d-ea51-4292-bc56-7dd45d3ff3c8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:34.173765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2978488-1c05-4071-8002-a8bfafb883a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:34.174533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2978488-1c05-4071-8002-a8bfafb883a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:34.175233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2978488-1c05-4071-8002-a8bfafb883a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:34.175683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2978488-1c05-4071-8002-a8bfafb883a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:34.186558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2978488-1c05-4071-8002-a8bfafb883a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:34.188714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2978488-1c05-4071-8002-a8bfafb883a8 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:34.199123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 948/1928] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:44.050671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=62,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:44.194587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:50.264308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:50.266246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:50.478203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538b34-dac1-49e1-9c48-cfaa2340efd3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:50.486944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:50.488135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:50.488855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:50.489515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] PATH_INFO: `/v3/users/2ce5e171fce949228b50eb70c3901595` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:50.492050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce5e171fce949228b50eb70c3901595)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:50.495914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:50.627265 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce5e171fce949228b50eb70c3901595'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:50.628021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce5e171fce949228b50eb70c3901595'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:50.646670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce5e171fce949228b50eb70c3901595'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:50.678489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce5e171fce949228b50eb70c3901595'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:50.697912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce5e171fce949228b50eb70c3901595'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:50.708147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 981/1929] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:23:50 2022] DELETE /identity/v3/users/2ce5e171fce949228b50eb70c3901595 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:50.714964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:50.715728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:50.716370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:50.778276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:50.780796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:50.904884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 949/1930] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:50.979262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:50.982153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:51.148085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53067-37ac-4114-aa37-db4519f67c95 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:51.160653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734a995-1855-436e-ba31-69cf5a5b496a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:51.161770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734a995-1855-436e-ba31-69cf5a5b496a service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:51.162270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734a995-1855-436e-ba31-69cf5a5b496a service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:51.162747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734a995-1855-436e-ba31-69cf5a5b496a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:51.196663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734a995-1855-436e-ba31-69cf5a5b496a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:51.204247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734a995-1855-436e-ba31-69cf5a5b496a service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:51.233019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 982/1931] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:52.709643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:52.713108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:52.740559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9f07-e9e9-4b58-bcd0-eaf121877b40 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:52.748879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:52.750157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:52.750669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:52.751071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] PATH_INFO: `/v3/projects/3a9a369c74b9440da5bffd2eef7396ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:52.752791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9a369c74b9440da5bffd2eef7396ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:52.756756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:52.865450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9a369c74b9440da5bffd2eef7396ad', 'request_id': 'req-06649b5d-deb1-4595-9540-3e8b881d7411'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:52.880156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9a369c74b9440da5bffd2eef7396ad', 'request_id': 'req-06649b5d-deb1-4595-9540-3e8b881d7411'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:52.892206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9a369c74b9440da5bffd2eef7396ad', 'request_id': 'req-06649b5d-deb1-4595-9540-3e8b881d7411'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:52.919811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] The token cache is being invalidate because project 3a9a369c74b9440da5bffd2eef7396ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:23:52.920891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:52.922174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06649b5d-deb1-4595-9540-3e8b881d7411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:23:52.924798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 950/1932] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:23:52 2022] DELETE /identity/v3/projects/3a9a369c74b9440da5bffd2eef7396ad => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:23:52.931511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:52.932383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:52.932383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:52.965767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:52.967286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:52.990335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:53.060928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 983/1933] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:53.073735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.074634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.075120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.125333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:53.128526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:53.151365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 951/1934] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:53.157450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.170113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a867-fbfd-4adc-8103-f72ae9a138d1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:53.178146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:53.179142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.179633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.180128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.181398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:53.182121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:53.184529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:53.216378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 984/1935] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:53.222004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.236933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00dec0-7238-4ad5-a547-90a5fa736b7d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:53.245798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:53.247307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.247839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.249346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.250624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:53.257448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:53.310853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 952/1936] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:23:53 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:53.317358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.334664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c395836-4196-4512-a383-f9d44f64c1b4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:53.422596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:53.423407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.423787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.424198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.425951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:53.433662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:53.489981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 985/1937] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:53 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:53.496108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.517071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab870b-a4bb-4e15-8480-1cc171c57746 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:53.525202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:53.526466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.526722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.527485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.528717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:53.531834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:53.560987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.571046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 953/1938] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:23:53.580545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2520a-d299-46cf-8b3b-5693c28d0046 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:53.589534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38e74-3f16-4948-89fb-a506de249820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:53.591213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38e74-3f16-4948-89fb-a506de249820 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.591621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38e74-3f16-4948-89fb-a506de249820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.592114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38e74-3f16-4948-89fb-a506de249820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.595611 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38e74-3f16-4948-89fb-a506de249820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:53.596793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38e74-3f16-4948-89fb-a506de249820 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:53.624080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.632332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 986/1939] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:53.649050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bbfa8-1f54-4aeb-bcfa-5d8f35df24c4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:53.659387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:53.660101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.661399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.662037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] PATH_INFO: `/v3/projects/99994abe90d9440899ed4a7bf00d6bda/users/ae2819090d7b49dd931c705251e9fc49/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.685978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99994abe90d9440899ed4a7bf00d6bda, user_id=ae2819090d7b49dd931c705251e9fc49, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:53.689802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:53.718354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 954/1940] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:23:53 2022] PUT /identity/v3/projects/99994abe90d9440899ed4a7bf00d6bda/users/ae2819090d7b49dd931c705251e9fc49/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:53.726545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c1b2-da5b-4b2d-b0b7-315f6d09bce5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:53.726727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c1b2-da5b-4b2d-b0b7-315f6d09bce5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:53.727584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c1b2-da5b-4b2d-b0b7-315f6d09bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:53.763257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6de2c1b2-da5b-4b2d-b0b7-315f6d09bce5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:53.765191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6de2c1b2-da5b-4b2d-b0b7-315f6d09bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:53.906442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 987/1941] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:53.920063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:53.932503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:53.972830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:54.040446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c74e1-3d2f-45b8-a6ab-da992133f546 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:54.044583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:54.045289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:54.045570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:54.045845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:54.059202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:54.061895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:54.081272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 955/1942] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:55.489323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040a74-6346-4e38-92b0-7ea7c73bf02d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:55.489956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040a74-6346-4e38-92b0-7ea7c73bf02d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:55.489956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040a74-6346-4e38-92b0-7ea7c73bf02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:55.530224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-37040a74-6346-4e38-92b0-7ea7c73bf02d None None] MFA Rules not processed for user `ae2819090d7b49dd931c705251e9fc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:55.531643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-37040a74-6346-4e38-92b0-7ea7c73bf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:55.555638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:55.639093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 988/1943] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:23:55.653093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:55.654716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:55.742907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14474043-be6f-4f7b-99f2-1144b2223e5c service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:55.747410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609c1db-9d2d-4ae4-ba62-ce8ed728f4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:55.748116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609c1db-9d2d-4ae4-ba62-ce8ed728f4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:55.748402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609c1db-9d2d-4ae4-ba62-ce8ed728f4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:55.748710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609c1db-9d2d-4ae4-ba62-ce8ed728f4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:55.760940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609c1db-9d2d-4ae4-ba62-ce8ed728f4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:55.763258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609c1db-9d2d-4ae4-ba62-ce8ed728f4a0 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:55.789464 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 956/1944] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:57.558203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10f86-6e4d-4877-8523-0f438675e93d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:57.558781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10f86-6e4d-4877-8523-0f438675e93d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:57.558781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10f86-6e4d-4877-8523-0f438675e93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:57.590136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-52e10f86-6e4d-4877-8523-0f438675e93d None None] MFA Rules not processed for user `ae2819090d7b49dd931c705251e9fc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:57.591419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-52e10f86-6e4d-4877-8523-0f438675e93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:57.616020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 989/1945] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:23:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:02.042507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf7a8-21f8-4f28-86ce-c508f51b6a3f None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.043105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf7a8-21f8-4f28-86ce-c508f51b6a3f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.043105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf7a8-21f8-4f28-86ce-c508f51b6a3f None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.044653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 957/1946] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:24:02.083213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd529-30b0-46b0-845d-0518278eb015 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.083924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd529-30b0-46b0-845d-0518278eb015 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.083924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fd529-30b0-46b0-845d-0518278eb015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.115130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-282fd529-30b0-46b0-845d-0518278eb015 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:02.116855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-282fd529-30b0-46b0-845d-0518278eb015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:02.152294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaf7a8-21f8-4f28-86ce-c508f51b6a3f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:02.157118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4fcaf7a8-21f8-4f28-86ce-c508f51b6a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:02.205483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaf7a8-21f8-4f28-86ce-c508f51b6a3f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:02.218003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:02.219335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.219834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.220222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] PATH_INFO: `/v3/users/b80cf63a5f10485aa4a3869fa60d2300` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.221851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80cf63a5f10485aa4a3869fa60d2300)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:02.224044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:02.263398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 990/1947] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:02.274397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a971ae-cd40-45db-ae88-7f2d9baa99df None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.274799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a971ae-cd40-45db-ae88-7f2d9baa99df None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.275024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a971ae-cd40-45db-ae88-7f2d9baa99df None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.281147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 991/1948] 10.222.0.57 () {54 vars in 961 bytes} [Thu Sep 1 05:24:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:24:02.287255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.287538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.287811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.334328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80cf63a5f10485aa4a3869fa60d2300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:02.337983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:02.343921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:02.357208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80cf63a5f10485aa4a3869fa60d2300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:02.359484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80cf63a5f10485aa4a3869fa60d2300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:02.368105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 992/1949] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Sep 1 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:02.419541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80cf63a5f10485aa4a3869fa60d2300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:02.428647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80cf63a5f10485aa4a3869fa60d2300'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:02.437693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 958/1950] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:02 2022] DELETE /identity/v3/users/b80cf63a5f10485aa4a3869fa60d2300 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:02.483259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:02.507198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf5686-be9f-41bb-b8f4-89228b470282 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:02.597424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:02.598076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.598352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.598624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.600527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:02.619402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:02.622723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2d350-a3e8-4899-8bc8-bf64bf26ff13 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:02.665876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 993/1951] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:02.758071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:02.761253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:02.873789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:02.924962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c709-1e5b-4e70-8b40-f9beb67ae230 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:02.930727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:02.931518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:02.931774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:02.932086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] PATH_INFO: `/v3/projects/b05cbfc12aff4ddfa7607905aa7722e4` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:02.933357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05cbfc12aff4ddfa7607905aa7722e4)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:02.935342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.060557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05cbfc12aff4ddfa7607905aa7722e4', 'request_id': 'req-5846caa1-e764-42ba-930f-cdd9e79857a6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:03.069724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05cbfc12aff4ddfa7607905aa7722e4', 'request_id': 'req-5846caa1-e764-42ba-930f-cdd9e79857a6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:03.077928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05cbfc12aff4ddfa7607905aa7722e4', 'request_id': 'req-5846caa1-e764-42ba-930f-cdd9e79857a6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:03.097865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] The token cache is being invalidate because project b05cbfc12aff4ddfa7607905aa7722e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:03.098450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:03.100963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5846caa1-e764-42ba-930f-cdd9e79857a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:03.108021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 959/1952] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:02 2022] DELETE /identity/v3/projects/b05cbfc12aff4ddfa7607905aa7722e4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:03.109822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.110387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.110602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.138948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:03.141023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:03.178854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:03.232685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 994/1953] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:03.242016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.242016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.242016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.271518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:03.273275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:03.282716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 960/1954] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:03.291532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.308445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d139a35-da1b-4245-aa09-31eeaa3548ef None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:03.315554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:03.316449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.316855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.317244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.318034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:03.318751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:03.321783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.348518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 995/1955] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:03.350668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.368785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fca399-4c1e-443d-9f19-105765c60b1d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:03.377630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:03.378658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.379022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.379507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.380706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:03.393396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.459633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 961/1956] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:03 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:03.460443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.475424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a10719-7bfb-4afe-ba32-1f47139f1457 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:03.559290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:03.560321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.560692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.561080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.561895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:03.564384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.593407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 996/1957] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:03 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:03.595571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.607747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e179-987c-489f-9514-908a681b2edb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:03.613265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:03.613966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.614251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.614525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.615188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:03.616884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.632296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 962/1958] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:03.633539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.646715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32eda-acc9-4a77-9cd1-87ae139af380 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:03.653415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f34d5b-d2e6-43d5-8d65-e5520d30ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:03.654267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34d5b-d2e6-43d5-8d65-e5520d30ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.654267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34d5b-d2e6-43d5-8d65-e5520d30ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.654267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34d5b-d2e6-43d5-8d65-e5520d30ff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.655767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f34d5b-d2e6-43d5-8d65-e5520d30ff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:03.657261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f34d5b-d2e6-43d5-8d65-e5520d30ff4e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.673976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 997/1959] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:03.679144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.693336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348beb92-ee4f-4bcd-9312-172de32c4b4b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:03.702494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:03.703829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.704186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.704840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] PATH_INFO: `/v3/projects/d296e9ea3539432296f9a9ac3b8d1399/users/00d023e8b0d44b0faa34716c2e407681/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.734104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d296e9ea3539432296f9a9ac3b8d1399, user_id=00d023e8b0d44b0faa34716c2e407681, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:03.737542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:03.770220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 963/1960] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:03 2022] PUT /identity/v3/projects/d296e9ea3539432296f9a9ac3b8d1399/users/00d023e8b0d44b0faa34716c2e407681/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:03.772658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:03.773154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:03.773482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:03.807849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] MFA Rules not processed for user `00d023e8b0d44b0faa34716c2e407681`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:03.810233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:03.921914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 998/1961] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:03.933048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:03.936849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:04.082072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:04.096559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e499f1-d344-4351-91ac-826559ff1be3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:04.108462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:04.110022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:04.110650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:04.111414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:04.128380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:04.131791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:04.151026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 964/1962] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:05.687516 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:05.689246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:05.732942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:05.767748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33916b78-fcd4-4694-9620-213ac0205743 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:05.771567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:05.772291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:05.772511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:05.772823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:05.774819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:05.861736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:05.863478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017c46f-394c-4593-8a97-d387ed61be3c service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:05.878288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 999/1963] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:07.069273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:07.157294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d37db-f552-46d8-a069-8a8a0d8c86d6 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:07.167195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:07.168305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:07.168851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:07.169398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] PATH_INFO: `/v3/users/00d023e8b0d44b0faa34716c2e407681` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:07.171493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d023e8b0d44b0faa34716c2e407681)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:07.175235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:07.256404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d023e8b0d44b0faa34716c2e407681'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:07.271670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d023e8b0d44b0faa34716c2e407681'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:07.272351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d023e8b0d44b0faa34716c2e407681'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:07.290956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d023e8b0d44b0faa34716c2e407681'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:07.299949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d023e8b0d44b0faa34716c2e407681'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:07.307225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 965/1964] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:07 2022] DELETE /identity/v3/users/00d023e8b0d44b0faa34716c2e407681 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:07.313029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:07.313653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:07.313978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:07.347681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:07.349028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:07.436807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1000/1965] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:07.446490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:07.448000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:07.517333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa79c1-ba3c-4d9c-b438-0d63e220e6c4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:07.525446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ea657-229c-45b6-98d5-673efe02e20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:07.526125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea657-229c-45b6-98d5-673efe02e20a service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:07.526451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea657-229c-45b6-98d5-673efe02e20a service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:07.526820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ea657-229c-45b6-98d5-673efe02e20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:07.536932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ea657-229c-45b6-98d5-673efe02e20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:07.538386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ea657-229c-45b6-98d5-673efe02e20a service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:07.548578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 966/1966] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:07.891513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:07.893341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:07.911531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cde5-f9d9-4472-9d06-8d9f3e912a99 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:07.917597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:07.918527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:07.918899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:07.919433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] PATH_INFO: `/v3/projects/d296e9ea3539432296f9a9ac3b8d1399` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:07.921567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d296e9ea3539432296f9a9ac3b8d1399)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:07.925444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:07.996153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd296e9ea3539432296f9a9ac3b8d1399', 'request_id': 'req-6b0ec8d3-3483-445d-aa49-270d84cfc573'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:08.009568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd296e9ea3539432296f9a9ac3b8d1399', 'request_id': 'req-6b0ec8d3-3483-445d-aa49-270d84cfc573'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:08.022560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd296e9ea3539432296f9a9ac3b8d1399', 'request_id': 'req-6b0ec8d3-3483-445d-aa49-270d84cfc573'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:08.035902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:08.041410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] The token cache is being invalidate because project d296e9ea3539432296f9a9ac3b8d1399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:08.042471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:08.044326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-6b0ec8d3-3483-445d-aa49-270d84cfc573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:08.047473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1001/1967] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:07 2022] DELETE /identity/v3/projects/d296e9ea3539432296f9a9ac3b8d1399 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:24:08.055702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.056190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.056651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.091441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:08.093494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:08.103573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:08.204387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 967/1968] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:08.214384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.214818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.215356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.237667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:08.239043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:08.248209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1002/1969] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:08.253451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.265066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dcee7-cfa9-4c8c-8295-52a52b228882 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.271043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.271845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.272214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.272722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.273471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:08.273870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.276107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:08.292856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 968/1970] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:08.299436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.311667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6150f9-36e7-4566-a013-96f4ee75ffa7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.316983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.318030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.318030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.318366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.318820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.321058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:08.359864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1003/1971] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:08 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:08.362267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.377070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515bc6-3e3c-4528-bfe5-acc1f40301ac admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.444978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.445614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.445894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.446169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.446850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.448859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:08.483196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 969/1972] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:08 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:08.488234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.501168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590a0a0-a8cb-46b8-be1e-bccfd9846182 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.506953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.507602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.507873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.508142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.508846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.510509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:08.522874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1004/1973] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:08.528058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.543010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f3453-5e10-44c5-ad06-573ed245a5c3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.549527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d95e-3755-4f16-a506-1ba60c4ae0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.550169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d95e-3755-4f16-a506-1ba60c4ae0fd admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.550447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d95e-3755-4f16-a506-1ba60c4ae0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.550718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d95e-3755-4f16-a506-1ba60c4ae0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.551375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469d95e-3755-4f16-a506-1ba60c4ae0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.553121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469d95e-3755-4f16-a506-1ba60c4ae0fd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:08.565792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 970/1974] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:08.570452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.581375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5101-c4e0-492c-9870-4134d5089163 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.586497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.587153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.587426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.587695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] PATH_INFO: `/v3/projects/d7805c046a6e413795015619101c1e32/users/9cebb4bf85c5414f8101a7dd8d526115/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.605410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7805c046a6e413795015619101c1e32, user_id=9cebb4bf85c5414f8101a7dd8d526115, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.609603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:08.631892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1005/1975] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:08 2022] PUT /identity/v3/projects/d7805c046a6e413795015619101c1e32/users/9cebb4bf85c5414f8101a7dd8d526115/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:24:08.651050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.651547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.652039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.706278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] MFA Rules not processed for user `9cebb4bf85c5414f8101a7dd8d526115`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:08.707878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:08.836897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 971/1976] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:08.837045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:08.961512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe8fd-a05b-44b2-8a14-c0ec37426903 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:08.971082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:08.972465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:08.972645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:08.975820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:08.976553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:08.978620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.032227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1006/1977] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:08 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:09.034756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:09.056602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6799bbf-b3d2-41cf-a6c1-be6b9c8d4511 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:09.061003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:09.152422 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:09.154011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.154514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.155005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.156153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:09.159886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.194945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 972/1978] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:09 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:09.199611 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:09.212353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905db69-0202-4e35-bffa-0df1c71dd90e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:09.218761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:09.219418 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.219715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.219978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.220680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:09.222358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.235672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1007/1979] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:09.241049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:09.253905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b343e-fe5a-446c-8a8f-b3d9cd462aeb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:09.259066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:09.259911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.260239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.260550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] PATH_INFO: `/v3/projects/e570c8e69ede4e0e9d71754a179d6484/users/f0da35784dcc4ed4b8883102b129d48f/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.280574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e570c8e69ede4e0e9d71754a179d6484, user_id=f0da35784dcc4ed4b8883102b129d48f, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:09.283834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.301287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 973/1980] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:09 2022] PUT /identity/v3/projects/e570c8e69ede4e0e9d71754a179d6484/users/f0da35784dcc4ed4b8883102b129d48f/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:09.306417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:09.317884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829caf-43ff-4aa9-b198-d1d2a94ff897 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:09.410456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53ec5-3609-4ea9-8ae9-8005791209a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:09.411459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53ec5-3609-4ea9-8ae9-8005791209a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.411918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53ec5-3609-4ea9-8ae9-8005791209a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.412340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53ec5-3609-4ea9-8ae9-8005791209a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.413495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53ec5-3609-4ea9-8ae9-8005791209a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:09.416438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53ec5-3609-4ea9-8ae9-8005791209a4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.434414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1008/1981] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:24:09.439780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:09.456959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186628b-3d36-4b59-a3af-a7ac86cb1324 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:09.464488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:09.465644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.466143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.466587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] PATH_INFO: `/v3/projects/e570c8e69ede4e0e9d71754a179d6484/users/f0da35784dcc4ed4b8883102b129d48f/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.470403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e570c8e69ede4e0e9d71754a179d6484, user_id=f0da35784dcc4ed4b8883102b129d48f, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:09.474409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.490063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 974/1982] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:09 2022] PUT /identity/v3/projects/e570c8e69ede4e0e9d71754a179d6484/users/f0da35784dcc4ed4b8883102b129d48f/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:09.508072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.508581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.509040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.527076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:09.550924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] MFA Rules not processed for user `f0da35784dcc4ed4b8883102b129d48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:09.552438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:09.648760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1009/1983] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:09.661112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:09.662978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:09.751224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d7374-8718-44e9-b29c-b55bd400e272 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:09.757983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23500e0a-27d4-42e8-99e7-0c6f7d960ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:09.758898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23500e0a-27d4-42e8-99e7-0c6f7d960ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:09.759384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23500e0a-27d4-42e8-99e7-0c6f7d960ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:09.759858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23500e0a-27d4-42e8-99e7-0c6f7d960ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:09.776776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23500e0a-27d4-42e8-99e7-0c6f7d960ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:09.779727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23500e0a-27d4-42e8-99e7-0c6f7d960ad1 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:09.797830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 975/1984] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:09 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:09.961857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:10.035615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa048ca5-6c13-441f-88e8-59e3184d3c83 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:10.041384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:10.042184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:10.042560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:10.042942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] PATH_INFO: `/v3/users/9cebb4bf85c5414f8101a7dd8d526115` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:10.044325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cebb4bf85c5414f8101a7dd8d526115)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:10.046641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:10.120514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cebb4bf85c5414f8101a7dd8d526115'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:10.121986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cebb4bf85c5414f8101a7dd8d526115'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:10.138381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cebb4bf85c5414f8101a7dd8d526115'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:10.164335 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cebb4bf85c5414f8101a7dd8d526115'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:10.178220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cebb4bf85c5414f8101a7dd8d526115'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:10.189874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1010/1985] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:09 2022] DELETE /identity/v3/users/9cebb4bf85c5414f8101a7dd8d526115 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:10.195581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:10.196353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:10.196353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:10.225561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:10.226811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:10.323169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 976/1986] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:10.335968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:10.337531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:10.365915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:10.495656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e38ee-f6f7-4eae-9ca3-0dbc27a3aa43 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:10.499968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:10.500607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:10.500932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:10.501203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:10.511810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:10.513463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:10.524667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1011/1987] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:10.879652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:10.881958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:10.897127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:10.906798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46f363-9fee-4eee-a010-6926adfa2fa0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:10.916579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:10.918091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:10.918890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:10.919585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] PATH_INFO: `/v3/projects/d7805c046a6e413795015619101c1e32` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:10.922368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7805c046a6e413795015619101c1e32)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:10.926731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:11.027415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7805c046a6e413795015619101c1e32', 'request_id': 'req-730bc75e-9def-4d6f-a245-e63922203b4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.040524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7805c046a6e413795015619101c1e32', 'request_id': 'req-730bc75e-9def-4d6f-a245-e63922203b4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.054025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7805c046a6e413795015619101c1e32', 'request_id': 'req-730bc75e-9def-4d6f-a245-e63922203b4a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.078316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] The token cache is being invalidate because project d7805c046a6e413795015619101c1e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:11.078801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.080147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.082769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 977/1988] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:10 2022] DELETE /identity/v3/projects/d7805c046a6e413795015619101c1e32 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:11.088354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:11.100279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac332-9519-4fef-be8f-bbf0d123458a service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:11.173642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:11.174293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:11.174709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:11.175202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] PATH_INFO: `/v3/users/f0da35784dcc4ed4b8883102b129d48f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:11.176723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0da35784dcc4ed4b8883102b129d48f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:11.178827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:11.253099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0da35784dcc4ed4b8883102b129d48f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.253884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0da35784dcc4ed4b8883102b129d48f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.266602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0da35784dcc4ed4b8883102b129d48f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.283314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0da35784dcc4ed4b8883102b129d48f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.291849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-afe92c4a-0ec1-49e3-890a-409a882e18c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0da35784dcc4ed4b8883102b129d48f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.300119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1012/1989] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:11 2022] DELETE /identity/v3/users/f0da35784dcc4ed4b8883102b129d48f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:11.726409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:11.728579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:11.751617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc75e-9def-4d6f-a245-e63922203b4a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:11.848009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:11.848703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:11.848983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:11.849253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] PATH_INFO: `/v3/projects/e570c8e69ede4e0e9d71754a179d6484` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:11.850441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e570c8e69ede4e0e9d71754a179d6484)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:11.852399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:11.906272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e570c8e69ede4e0e9d71754a179d6484', 'request_id': 'req-aeb73d26-277c-48fb-bbb1-361ee2940d0a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.912292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e570c8e69ede4e0e9d71754a179d6484', 'request_id': 'req-aeb73d26-277c-48fb-bbb1-361ee2940d0a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.919234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e570c8e69ede4e0e9d71754a179d6484', 'request_id': 'req-aeb73d26-277c-48fb-bbb1-361ee2940d0a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.940051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] The token cache is being invalidate because project e570c8e69ede4e0e9d71754a179d6484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:11.940557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.941691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-aeb73d26-277c-48fb-bbb1-361ee2940d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:11.944140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 978/1990] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:11 2022] DELETE /identity/v3/projects/e570c8e69ede4e0e9d71754a179d6484 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:11.954213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:11.954856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:11.954856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:11.983068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:11.985316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:12.025204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:12.083249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1013/1991] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:12.092153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.092710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.093206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.129118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:12.130328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:12.140039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 979/1992] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:12.144901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.156241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0ee3-bdb8-4717-b32d-79a88f586c17 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.161870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.162503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.162777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.163047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.163730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:12.164025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.165746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.184786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1014/1993] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:24:12.190008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.202765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1db5-90f2-4826-8528-e8c47466ff77 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.207819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.208482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.208956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.209228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.209887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.211862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.218468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:12.248790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 980/1994] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:12 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:12.254250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.272406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57782e-6003-4fc3-a781-c3b9b3d83af1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.349432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.350071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.350348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.350617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.351323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.353390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.379648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1015/1995] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:12 2022] POST /identity/v3/users => generated 305 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:12.384811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.400884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246352-d7eb-404e-ad07-62442952dcaa admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.408156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.408861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.409139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.409390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.410046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.411803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.424226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 981/1996] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:12.429073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.440302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c40f07-281a-43ef-a157-edb9ecd5ddf3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.445486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5539c-40b3-4456-81b8-0516acc0e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.445966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5539c-40b3-4456-81b8-0516acc0e5db admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.446249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5539c-40b3-4456-81b8-0516acc0e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.446519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5539c-40b3-4456-81b8-0516acc0e5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.447270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5539c-40b3-4456-81b8-0516acc0e5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.448969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5539c-40b3-4456-81b8-0516acc0e5db admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.462218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1016/1997] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:24:12.467628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.478671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64925fba-1807-4c08-92e3-4322d0615701 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.484080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.484803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.485078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.485350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] PATH_INFO: `/v3/projects/ad2fc1750e844938a7340d30126e536b/users/0d533d77330f417faa86fc0dff6a4bff/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.504357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2fc1750e844938a7340d30126e536b, user_id=0d533d77330f417faa86fc0dff6a4bff, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.507197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.524348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 982/1998] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:12 2022] PUT /identity/v3/projects/ad2fc1750e844938a7340d30126e536b/users/0d533d77330f417faa86fc0dff6a4bff/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:12.536236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.536781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.537171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.571486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] MFA Rules not processed for user `0d533d77330f417faa86fc0dff6a4bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:12.572796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:12.689697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1017/1999] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:12 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:12.694379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.808363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3436-4185-47cf-b3ff-4db6b9d4212b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.816684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:12.817779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:12.818248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:12.818974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:12.819897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:12.823639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:12.886630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 983/2000] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:12 2022] POST /identity/v3/projects => generated 409 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:12.888228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:12.927536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa017063-67f4-4558-a5f7-211da8e620fe None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:12.979795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:13.042430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:13.046565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.047287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.048675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.049569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:13.053901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:13.083689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1018/2001] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:12 2022] POST /identity/v3/users => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:13.088262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:13.100293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0634a9-7d33-428b-b25a-efad31260ad3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:13.105210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:13.105841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.106115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.106463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.107350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:13.109221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:13.122656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 984/2002] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:13.127150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:13.138496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87331f5-7af2-4133-b0a2-e8cdba9d92c6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:13.144805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:13.145511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.145787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.146064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] PATH_INFO: `/v3/projects/2ccf0af0dd504dc0bdefc94ed846e4d1/users/d229f97be37e42e188823d958e310958/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.172481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccf0af0dd504dc0bdefc94ed846e4d1, user_id=d229f97be37e42e188823d958e310958, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:13.175356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:13.207518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1019/2003] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:13 2022] PUT /identity/v3/projects/2ccf0af0dd504dc0bdefc94ed846e4d1/users/d229f97be37e42e188823d958e310958/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:13.211753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:13.230526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7252d-2a06-44bc-a95b-49a11abb0b68 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:13.339252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2dcde-6e9e-40f2-b7f9-e0b5529bda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:13.340457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2dcde-6e9e-40f2-b7f9-e0b5529bda00 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.340823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2dcde-6e9e-40f2-b7f9-e0b5529bda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.341182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2dcde-6e9e-40f2-b7f9-e0b5529bda00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.341862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2dcde-6e9e-40f2-b7f9-e0b5529bda00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:13.344365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2dcde-6e9e-40f2-b7f9-e0b5529bda00 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:13.362167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 985/2004] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:13.375695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:13.390399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49addbff-32f7-400d-a555-fa3ba4de991b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:13.395686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:13.396943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.397395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.397856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] PATH_INFO: `/v3/projects/2ccf0af0dd504dc0bdefc94ed846e4d1/users/d229f97be37e42e188823d958e310958/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.400183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccf0af0dd504dc0bdefc94ed846e4d1, user_id=d229f97be37e42e188823d958e310958, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:13.403301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:13.417572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1020/2005] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:13 2022] PUT /identity/v3/projects/2ccf0af0dd504dc0bdefc94ed846e4d1/users/d229f97be37e42e188823d958e310958/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:13.429973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.430456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.430993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.513681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] MFA Rules not processed for user `d229f97be37e42e188823d958e310958`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:13.515901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:13.534825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:13.650482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 986/2006] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:13 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:13.660814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:13.662971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:13.758535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866c6c8-c72c-443e-93d7-f9fa94edc9d9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:13.763626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:13.764580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:13.764773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:13.765126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:13.778754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:13.781395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:13.793016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1021/2007] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:13 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:14.041024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:14.057806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26de246-360f-4aa1-84ba-af438b04cd56 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:14.066547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:14.067591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:14.067919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:14.069146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:14.218236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:14.221093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:14.237100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 987/2008] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:14 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:19.893573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:19.895124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:19.978066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d459b-d748-4b25-a8de-aff6fe44ba7e service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:19.984551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:19.985953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:19.986302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:19.986582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] PATH_INFO: `/v3/users/560897221f004e36aa47cebe694b9b79` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:19.988095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] RBAC: Authorizing `identity:delete_user(user_id=560897221f004e36aa47cebe694b9b79)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:19.990145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:20.027547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:20.060426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560897221f004e36aa47cebe694b9b79'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.061642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560897221f004e36aa47cebe694b9b79'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.071865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560897221f004e36aa47cebe694b9b79'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.095894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560897221f004e36aa47cebe694b9b79'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.105765 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-faba66eb-c900-4231-9b62-11f160a132db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560897221f004e36aa47cebe694b9b79'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.116536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1022/2009] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:19 2022] DELETE /identity/v3/users/560897221f004e36aa47cebe694b9b79 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:20.120432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:20.124400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:20.124400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:20.124693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:20.141768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0525-7df1-4958-afe3-222eee516612 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:20.147273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:20.148565 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:20.232752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:20.233430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:20.233705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:20.233999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] PATH_INFO: `/v3/users/0d533d77330f417faa86fc0dff6a4bff` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:20.235282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d533d77330f417faa86fc0dff6a4bff)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:20.237286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:20.238079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1023/2010] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:20.272304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:20.273887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:20.309901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d533d77330f417faa86fc0dff6a4bff'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.313505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:20.342866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d533d77330f417faa86fc0dff6a4bff'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.344266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d533d77330f417faa86fc0dff6a4bff'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.372018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d533d77330f417faa86fc0dff6a4bff'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.384034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48633d-ec0d-46ee-933f-faefc82b7693 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:20.386413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3f392123-ff21-40fe-9161-6d454719ac76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d533d77330f417faa86fc0dff6a4bff'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:20.389514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:20.390677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:20.390962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:20.399090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 988/2011] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:20 2022] DELETE /identity/v3/users/0d533d77330f417faa86fc0dff6a4bff => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:20.401836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:20.405018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:20.405736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:20.406319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:20.407538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:20.431557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:20.434689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:20.442968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:20.444536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:20.447653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1024/2012] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:20.556777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 989/2013] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:20.577121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:20.578863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:20.595594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51db30d-2cff-4dad-af26-6bd1d61c936a service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:20.695115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:20.702600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:20.703422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:20.703926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:20.704230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:20.718117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:20.718673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:20.732390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1025/2014] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:20.912151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:20.914303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:20.953762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31548f79-3189-4a2e-a8dd-b1181b35cbf3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:20.961630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:20.961630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:20.961630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:20.961630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] PATH_INFO: `/v3/projects/8e05204d1d55427e8e341714dc6837a9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:20.963652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e05204d1d55427e8e341714dc6837a9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:20.966738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:21.090632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e05204d1d55427e8e341714dc6837a9', 'request_id': 'req-59965172-5646-4110-9641-9561a4ff53c8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.102564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e05204d1d55427e8e341714dc6837a9', 'request_id': 'req-59965172-5646-4110-9641-9561a4ff53c8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.113168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e05204d1d55427e8e341714dc6837a9', 'request_id': 'req-59965172-5646-4110-9641-9561a4ff53c8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.142895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] The token cache is being invalidate because project 8e05204d1d55427e8e341714dc6837a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:21.143599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.144422 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.148378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 990/2015] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:20 2022] DELETE /identity/v3/projects/8e05204d1d55427e8e341714dc6837a9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:24:21.183993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:21.187688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:21.212467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb59d-0063-48cc-a136-14d362e98f67 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:21.301846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:21.302697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:21.303399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:21.303771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] PATH_INFO: `/v3/projects/ad2fc1750e844938a7340d30126e536b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:21.305776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2fc1750e844938a7340d30126e536b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:21.309494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:21.403214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2fc1750e844938a7340d30126e536b', 'request_id': 'req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.413188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2fc1750e844938a7340d30126e536b', 'request_id': 'req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.423503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2fc1750e844938a7340d30126e536b', 'request_id': 'req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.435455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] The token cache is being invalidate because project ad2fc1750e844938a7340d30126e536b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:21.435750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.436415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.438103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1026/2016] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:21 2022] DELETE /identity/v3/projects/ad2fc1750e844938a7340d30126e536b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:21.442329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:21.444104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:21.459176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59965172-5646-4110-9641-9561a4ff53c8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:21.507998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:21.523156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:21.523810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:21.524085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:21.524345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] PATH_INFO: `/v3/users/d229f97be37e42e188823d958e310958` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:21.525619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d229f97be37e42e188823d958e310958)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:21.527577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:21.587455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd229f97be37e42e188823d958e310958'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.596285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd229f97be37e42e188823d958e310958'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.597179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd229f97be37e42e188823d958e310958'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.613717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd229f97be37e42e188823d958e310958'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.621678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffd3581b-5e3a-44f7-af90-8ac1b93369c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd229f97be37e42e188823d958e310958'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:21.627926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 991/2017] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:21 2022] DELETE /identity/v3/users/d229f97be37e42e188823d958e310958 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:22.005738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.007253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:22.031320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69a6af-133a-4ab2-a8bc-8942373cf9d1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.106253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.106999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.107267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.107564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] PATH_INFO: `/v3/projects/2ccf0af0dd504dc0bdefc94ed846e4d1` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.108751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccf0af0dd504dc0bdefc94ed846e4d1)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.110736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.143849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:22.176863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccf0af0dd504dc0bdefc94ed846e4d1', 'request_id': 'req-263a2fab-522b-455f-a88d-a24951ec5f55'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:22.183090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccf0af0dd504dc0bdefc94ed846e4d1', 'request_id': 'req-263a2fab-522b-455f-a88d-a24951ec5f55'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:22.193250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccf0af0dd504dc0bdefc94ed846e4d1', 'request_id': 'req-263a2fab-522b-455f-a88d-a24951ec5f55'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:22.204503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] The token cache is being invalidate because project 2ccf0af0dd504dc0bdefc94ed846e4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:22.205498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:22.206234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-263a2fab-522b-455f-a88d-a24951ec5f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:22.207956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1027/2018] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:22 2022] DELETE /identity/v3/projects/2ccf0af0dd504dc0bdefc94ed846e4d1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:22.213353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.214243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.214523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.237650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:22.238916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:22.304065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 992/2019] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:22.316312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.316590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.316905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.338775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:22.340044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:22.350372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1028/2020] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:22.355691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.367339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a620e-f19c-4f5c-838a-92718b5920e6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.373276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.374114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.374392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.374662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.375559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:22.375743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.377385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.394294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 993/2021] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:22.398747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.409128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516132c-6eb5-4b88-884d-34e010529c0a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.414083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.414724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.414997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.415268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.415916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.417857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.451146 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1029/2022] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:22 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:22.455826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.466733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ef1fe-15c1-4b73-9e84-c9fc5bf43eeb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.543901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:22.552451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.553839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.554116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.554406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.555057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.557062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.592948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 994/2023] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:22 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:22.597433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.610178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30504d0a-11e6-4fcd-a38b-0205fb51840d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.615556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.616178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.616455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.616751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.617625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.619250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.633931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1030/2024] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:22.636953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.648139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043716-d706-4c55-8a52-317d5349005b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.653843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a64f2-335f-4022-bb02-5faa9ecff584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.654477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a64f2-335f-4022-bb02-5faa9ecff584 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.654751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a64f2-335f-4022-bb02-5faa9ecff584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.655020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a64f2-335f-4022-bb02-5faa9ecff584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.655839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a64f2-335f-4022-bb02-5faa9ecff584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.657972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a64f2-335f-4022-bb02-5faa9ecff584 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.673137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 995/2025] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:22.674345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.688885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d31a01-5753-4ad1-9c68-d417af0bba2e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.694420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.695318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.695694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.695967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] PATH_INFO: `/v3/projects/22520a4f5d83443cbbe400e58ec9f44b/users/c35c153e53de419f8ac9e81980bac40d/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.714069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22520a4f5d83443cbbe400e58ec9f44b, user_id=c35c153e53de419f8ac9e81980bac40d, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.717553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:22.736916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1031/2026] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:22 2022] PUT /identity/v3/projects/22520a4f5d83443cbbe400e58ec9f44b/users/c35c153e53de419f8ac9e81980bac40d/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:22.748370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.748659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.748957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.778982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] MFA Rules not processed for user `c35c153e53de419f8ac9e81980bac40d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:22.780198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:22.861762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 996/2027] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:22.866863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:22.966550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e9a4-8eb4-4172-9f70-c167c12b867a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:22.972116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:22.972854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:22.973127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:22.973404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:22.974116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:22.976104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.019008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1032/2028] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:22 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:23.022888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:23.039813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b01a-a263-4e5d-9adf-c9b86126be1a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:23.144909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:23.146138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.146620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.147096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.148243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:23.152001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.187505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 997/2029] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:23 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:23.191937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:23.204058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a7c6-5dcf-49cc-bd59-79c0fb9ec5f7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:23.210502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:23.211142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.211414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.211678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.212324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:23.214011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.226382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1033/2030] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:23.231284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:23.244334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f041-54d0-40f2-ba2e-e76ff1bf9e04 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:23.250633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:23.251318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.251597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.251868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] PATH_INFO: `/v3/projects/1006f0d619dd45629c6b28c25b0f9bb2/users/7845e0e54f6640e7ad2852a4cb914eb5/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.268820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1006f0d619dd45629c6b28c25b0f9bb2, user_id=7845e0e54f6640e7ad2852a4cb914eb5, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:23.271764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.288499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 998/2031] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:23 2022] PUT /identity/v3/projects/1006f0d619dd45629c6b28c25b0f9bb2/users/7845e0e54f6640e7ad2852a4cb914eb5/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:23.293452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:23.304860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a355a-f263-4ece-affd-e994375f11ba admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:23.323640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:23.374184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca2809-ac87-462b-bf6d-ff4229de33c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:23.374816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca2809-ac87-462b-bf6d-ff4229de33c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.375148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca2809-ac87-462b-bf6d-ff4229de33c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.375413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca2809-ac87-462b-bf6d-ff4229de33c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.376085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca2809-ac87-462b-bf6d-ff4229de33c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:23.377786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca2809-ac87-462b-bf6d-ff4229de33c3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.394691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1034/2032] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:23.399212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:23.412549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21029f-d63d-44a0-9e7c-75d9622e2608 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:23.418100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:23.419291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.419690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.419972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] PATH_INFO: `/v3/projects/1006f0d619dd45629c6b28c25b0f9bb2/users/7845e0e54f6640e7ad2852a4cb914eb5/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.422495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1006f0d619dd45629c6b28c25b0f9bb2, user_id=7845e0e54f6640e7ad2852a4cb914eb5, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:23.425607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.439105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 999/2033] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:23 2022] PUT /identity/v3/projects/1006f0d619dd45629c6b28c25b0f9bb2/users/7845e0e54f6640e7ad2852a4cb914eb5/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:23.451438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.451719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.452065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.482421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] MFA Rules not processed for user `7845e0e54f6640e7ad2852a4cb914eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:23.483658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:23.570248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1035/2034] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:23.582915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:23.585101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:23.605129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:23.652974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa89458-dfc5-44d6-bebd-812106ebf024 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:23.656864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ec201-9db0-4886-bedd-5c9c38fd2d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:23.657478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec201-9db0-4886-bedd-5c9c38fd2d81 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:23.657724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec201-9db0-4886-bedd-5c9c38fd2d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:23.658016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec201-9db0-4886-bedd-5c9c38fd2d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:23.668109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ec201-9db0-4886-bedd-5c9c38fd2d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:23.669739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ec201-9db0-4886-bedd-5c9c38fd2d81 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:23.680891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1000/2035] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:24.491909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:24.564052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471e5e-cb0c-4a80-ba90-a606750833e0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:24.569332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:24.569977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:24.570244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:24.570535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] PATH_INFO: `/v3/users/c35c153e53de419f8ac9e81980bac40d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:24.571699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35c153e53de419f8ac9e81980bac40d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:24.573680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:24.631583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:24.634813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35c153e53de419f8ac9e81980bac40d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:24.635751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35c153e53de419f8ac9e81980bac40d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:24.645721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35c153e53de419f8ac9e81980bac40d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:24.659965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35c153e53de419f8ac9e81980bac40d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:24.667920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35c153e53de419f8ac9e81980bac40d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:24.675038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1036/2036] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:24 2022] DELETE /identity/v3/users/c35c153e53de419f8ac9e81980bac40d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:24.679891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:24.680451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:24.680614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:24.701867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:24.703120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:24.778790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1001/2037] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:24.798371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:24.800126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:24.874700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205428f-da08-4890-bed2-a713f62ea8d6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:24.878800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:24.879437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:24.879793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:24.879994 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:24.896300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:24.899417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:24.919740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1037/2038] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:25.285862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:25.288276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:25.306376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fd0dc-c833-4d67-9c80-e088d6410b3f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:25.312536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:25.313259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:25.313612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:25.313824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] PATH_INFO: `/v3/projects/22520a4f5d83443cbbe400e58ec9f44b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:25.315050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22520a4f5d83443cbbe400e58ec9f44b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:25.317025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:25.389094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22520a4f5d83443cbbe400e58ec9f44b', 'request_id': 'req-c66314a8-8ed6-4408-a382-8624c690e151'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.397542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22520a4f5d83443cbbe400e58ec9f44b', 'request_id': 'req-c66314a8-8ed6-4408-a382-8624c690e151'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.407960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22520a4f5d83443cbbe400e58ec9f44b', 'request_id': 'req-c66314a8-8ed6-4408-a382-8624c690e151'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.433195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] The token cache is being invalidate because project 22520a4f5d83443cbbe400e58ec9f44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:25.433195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.433195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.434671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1002/2039] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:25 2022] DELETE /identity/v3/projects/22520a4f5d83443cbbe400e58ec9f44b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:25.439698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:25.453424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b7b16-05d3-4844-bf1b-7d4e848780e9 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:25.530503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:25.532045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:25.532509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:25.532819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] PATH_INFO: `/v3/users/7845e0e54f6640e7ad2852a4cb914eb5` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:25.534968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7845e0e54f6640e7ad2852a4cb914eb5)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:25.537038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:25.615344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7845e0e54f6640e7ad2852a4cb914eb5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.616152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7845e0e54f6640e7ad2852a4cb914eb5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.625981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7845e0e54f6640e7ad2852a4cb914eb5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.642030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:25.645067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7845e0e54f6640e7ad2852a4cb914eb5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.656084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ec722ecb-bd6a-4871-83aa-0259b3ce1cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7845e0e54f6640e7ad2852a4cb914eb5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:25.662727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1038/2040] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:25 2022] DELETE /identity/v3/users/7845e0e54f6640e7ad2852a4cb914eb5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:26.006042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.007176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:26.055292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66314a8-8ed6-4408-a382-8624c690e151 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.102293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:26.135378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.136041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.136319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.136591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] PATH_INFO: `/v3/projects/1006f0d619dd45629c6b28c25b0f9bb2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.138654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1006f0d619dd45629c6b28c25b0f9bb2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.140663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.197471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1006f0d619dd45629c6b28c25b0f9bb2', 'request_id': 'req-f4beb200-2d34-4942-a060-2a8d0a0475a2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:26.204506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1006f0d619dd45629c6b28c25b0f9bb2', 'request_id': 'req-f4beb200-2d34-4942-a060-2a8d0a0475a2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:26.211854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1006f0d619dd45629c6b28c25b0f9bb2', 'request_id': 'req-f4beb200-2d34-4942-a060-2a8d0a0475a2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:26.230088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] The token cache is being invalidate because project 1006f0d619dd45629c6b28c25b0f9bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:26.230609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:26.232100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f4beb200-2d34-4942-a060-2a8d0a0475a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:26.233771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1003/2041] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:26 2022] DELETE /identity/v3/projects/1006f0d619dd45629c6b28c25b0f9bb2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:26.240023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.240484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.240866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.262990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:26.264251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:26.335735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1039/2042] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:26.344853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.345136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.345423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.367402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:26.368505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:26.377624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1004/2043] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:26.382358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.396545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515d8cd-c21f-4f4a-b35d-7b420b97bc2c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.404992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.405634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.405907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.406173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.406858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:26.407166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.409171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.422777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1040/2044] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:26.428381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.443177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36669d0-4385-4a08-9dde-05d990901350 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.452190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.453286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.453773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.454246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.455349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.459230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.515952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1005/2045] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:26 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:26.522490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.540246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0cb9-22d4-4cd7-8fe7-ab4cd902b2b4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.666583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.667867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.668429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.669120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.670321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.672536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.705785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1041/2046] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:26 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:26.710888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.725896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941529d5-2aed-4d23-b055-cbe606f761b9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.733887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.735403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.736047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.736434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.737703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.740944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.767839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1006/2047] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:26.773053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.788738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d2a3-5e6f-459e-9918-407b44244554 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.797113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aade1fb-676c-4779-bbc1-cc2eaaec8d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.798132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aade1fb-676c-4779-bbc1-cc2eaaec8d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.798639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aade1fb-676c-4779-bbc1-cc2eaaec8d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.799172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aade1fb-676c-4779-bbc1-cc2eaaec8d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.800381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aade1fb-676c-4779-bbc1-cc2eaaec8d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.803354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aade1fb-676c-4779-bbc1-cc2eaaec8d12 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.818196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1042/2048] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:26.823766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:26.852065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360cabe-2ecf-4246-addf-e4752665c1a6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:26.861849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:26.863201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.863771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.864331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] PATH_INFO: `/v3/projects/e4f370d2f9a64beba03d5eae2d422d19/users/d0d8553d0ad64b2eaf496249bb133231/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:26.897580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f370d2f9a64beba03d5eae2d422d19, user_id=d0d8553d0ad64b2eaf496249bb133231, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:26.912900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:26.964713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1007/2049] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:26 2022] PUT /identity/v3/projects/e4f370d2f9a64beba03d5eae2d422d19/users/d0d8553d0ad64b2eaf496249bb133231/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:24:26.971536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:26.972159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:26.975554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:27.040115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] MFA Rules not processed for user `d0d8553d0ad64b2eaf496249bb133231`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:27.042739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:27.125614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:27.173464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1043/2050] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:27.200533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:27.203876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:27.297593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a3eaa-9756-46f0-8e15-df6b0146b3ab admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:27.301746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4d51-09f0-4c7c-b308-07be7f0cce29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:27.302433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4d51-09f0-4c7c-b308-07be7f0cce29 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:27.302710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4d51-09f0-4c7c-b308-07be7f0cce29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:27.303044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4d51-09f0-4c7c-b308-07be7f0cce29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:27.312493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b4d51-09f0-4c7c-b308-07be7f0cce29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:27.313983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b4d51-09f0-4c7c-b308-07be7f0cce29 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:27.325201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1008/2051] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:27.352546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:27.431754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c883-c50f-4656-bf7d-f1cd212af931 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:27.437733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:27.438464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:27.438735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:27.439030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] PATH_INFO: `/v3/users/d0d8553d0ad64b2eaf496249bb133231` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:27.440924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d8553d0ad64b2eaf496249bb133231)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:27.443044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:27.514779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d8553d0ad64b2eaf496249bb133231'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:27.516107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d8553d0ad64b2eaf496249bb133231'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:27.527200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d8553d0ad64b2eaf496249bb133231'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:27.548547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d8553d0ad64b2eaf496249bb133231'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:27.558446 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d8553d0ad64b2eaf496249bb133231'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:27.568437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1044/2052] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:27 2022] DELETE /identity/v3/users/d0d8553d0ad64b2eaf496249bb133231 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:24:27.574320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:27.574850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:27.575233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:27.615790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:27.617090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:27.625009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:27.710950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1009/2053] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:27.722154 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:27.723722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:27.790218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf72352-988e-4241-9e5c-8b494c53a79d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:27.794497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2820f-6f9b-4072-b392-34300a4829b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:27.795130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2820f-6f9b-4072-b392-34300a4829b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:27.795404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2820f-6f9b-4072-b392-34300a4829b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:27.795669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2820f-6f9b-4072-b392-34300a4829b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:27.806923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2820f-6f9b-4072-b392-34300a4829b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:27.808459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2820f-6f9b-4072-b392-34300a4829b4 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:27.815274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:27.821533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1045/2054] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:28.220839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:28.222896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:28.257988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fa964-e5db-47eb-aa37-2ac404751649 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:28.264423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:28.265443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.265915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.266594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] PATH_INFO: `/v3/projects/e4f370d2f9a64beba03d5eae2d422d19` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.268302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f370d2f9a64beba03d5eae2d422d19)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:28.270451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:28.371433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f370d2f9a64beba03d5eae2d422d19', 'request_id': 'req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:28.381671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f370d2f9a64beba03d5eae2d422d19', 'request_id': 'req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:28.396749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f370d2f9a64beba03d5eae2d422d19', 'request_id': 'req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:28.426714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] The token cache is being invalidate because project e4f370d2f9a64beba03d5eae2d422d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:28.427229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:28.428305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4da2dcab-03d6-48f7-9abc-bbc271dc45fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:28.430561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1010/2055] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:28 2022] DELETE /identity/v3/projects/e4f370d2f9a64beba03d5eae2d422d19 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:28.436589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.436999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.437312 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.459866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:28.461503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:28.541667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1046/2056] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:28.551093 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.551370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.551643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.573667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:28.574934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:28.583885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1011/2057] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:28.588824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:28.600190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3455e-0838-4cb7-9ade-a558d1275769 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:28.605264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:28.606018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.606289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.606579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.607261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:28.607554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:28.609301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:28.623103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1047/2058] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:28.627525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:28.637743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920e11d-c829-4b5e-92cd-acbe419020fc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:28.644026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:28.645171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.645634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.646086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.647204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:28.650934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:28.703713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1012/2059] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:28 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:28.709112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:28.736479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07bc34-bfe7-4d1c-b097-a22605d8a660 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:28.820267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:28.821348 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.821846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.822352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.823513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:28.827453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:28.861706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1048/2060] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:28 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:28.867265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:28.881066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab4ef-0d80-4858-89ab-49288d9df84e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:28.890645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:28.891298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.891609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.891851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.892570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:28.894292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:28.906372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1013/2061] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:28.911032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:28.939862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78676-b66a-4115-a6c0-f3ee94a57414 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:28.948041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a17657-b6d3-4cd9-9ecc-1a031638079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:28.949110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a17657-b6d3-4cd9-9ecc-1a031638079f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:28.949677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a17657-b6d3-4cd9-9ecc-1a031638079f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:28.950380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a17657-b6d3-4cd9-9ecc-1a031638079f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:28.951568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a17657-b6d3-4cd9-9ecc-1a031638079f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:28.954545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a17657-b6d3-4cd9-9ecc-1a031638079f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:28.976179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1049/2062] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:28.983175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:29.007217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93b5a3-ebfc-44f3-84c8-50d7cb5977c6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:29.012760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:29.013857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:29.014321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:29.014592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] PATH_INFO: `/v3/projects/90b821867cf7485397b8e93234ca2df7/users/11b81f4af3d74843ada0a9315d12d037/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:29.035811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b821867cf7485397b8e93234ca2df7, user_id=11b81f4af3d74843ada0a9315d12d037, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:29.038849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:29.064156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1014/2063] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:28 2022] PUT /identity/v3/projects/90b821867cf7485397b8e93234ca2df7/users/11b81f4af3d74843ada0a9315d12d037/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:29.081710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc52c-a142-4540-8e67-8cf681818874 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:29.082191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc52c-a142-4540-8e67-8cf681818874 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:29.082667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc52c-a142-4540-8e67-8cf681818874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:29.134046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-10bfc52c-a142-4540-8e67-8cf681818874 None None] MFA Rules not processed for user `11b81f4af3d74843ada0a9315d12d037`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:29.136395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-10bfc52c-a142-4540-8e67-8cf681818874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:29.267246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:29.288365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1050/2064] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:29.300135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:29.302099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:29.363102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:29.418165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8e63-7996-4ec5-9b15-edb33101f5cb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:29.425163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded07b-96e5-4c73-bd13-785d7360bc0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:29.426227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded07b-96e5-4c73-bd13-785d7360bc0f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:29.426890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded07b-96e5-4c73-bd13-785d7360bc0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:29.428096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded07b-96e5-4c73-bd13-785d7360bc0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:29.446737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded07b-96e5-4c73-bd13-785d7360bc0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:29.450021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded07b-96e5-4c73-bd13-785d7360bc0f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:29.468207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1015/2065] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:32.253649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78428-a970-4c0e-a0af-c7b0b94c9040 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:32.254235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78428-a970-4c0e-a0af-c7b0b94c9040 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:32.254235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78428-a970-4c0e-a0af-c7b0b94c9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:32.275632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-f7d78428-a970-4c0e-a0af-c7b0b94c9040 None None] MFA Rules not processed for user `11b81f4af3d74843ada0a9315d12d037`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:32.276986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f7d78428-a970-4c0e-a0af-c7b0b94c9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:32.284559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1051/2066] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:35.053167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf23899-dd25-4632-8e99-c586bd80f56c None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:35.054103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf23899-dd25-4632-8e99-c586bd80f56c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:35.054103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf23899-dd25-4632-8e99-c586bd80f56c None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:35.057348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1016/2067] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:24:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:24:35.067464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:35.068488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:35.068886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:35.092136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] MFA Rules not processed for user `5cfb84f7920d4d92b0fb290ac4ee105b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:35.093605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:35.263375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1052/2068] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:24:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:35.283725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf23899-dd25-4632-8e99-c586bd80f56c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:35.286150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9cf23899-dd25-4632-8e99-c586bd80f56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:35.305629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf23899-dd25-4632-8e99-c586bd80f56c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:35.311585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:35.312226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:35.312506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:35.312818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:35.331662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:35.348273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:35.369965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1017/2069] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:36.196014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:36.198281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:36.294631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43c20f-9ad7-47be-b95f-f713d43c4f1c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:36.301416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:36.302430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:36.302898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:36.303336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] PATH_INFO: `/v3/users/bf87a279a3964cee8edb7989f72a3a67` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:36.305282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf87a279a3964cee8edb7989f72a3a67)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:36.308797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:36.390659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf87a279a3964cee8edb7989f72a3a67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:36.391331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf87a279a3964cee8edb7989f72a3a67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:36.420359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf87a279a3964cee8edb7989f72a3a67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:36.453313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf87a279a3964cee8edb7989f72a3a67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:36.469655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf87a279a3964cee8edb7989f72a3a67'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:36.481570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1053/2070] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:36 2022] DELETE /identity/v3/users/bf87a279a3964cee8edb7989f72a3a67 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:37.050576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:37.070426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c76b4-2d06-47d0-a8d7-65e73f3b2b9d service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:37.192234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:37.193690 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:37.194520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:37.195701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] PATH_INFO: `/v3/projects/d8410be155ae482c987dfeda4e5fb557` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:37.198108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8410be155ae482c987dfeda4e5fb557)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:37.203490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:37.286246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8410be155ae482c987dfeda4e5fb557', 'request_id': 'req-7315acbd-0734-4843-9f49-f8ce0991d203'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.297070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8410be155ae482c987dfeda4e5fb557', 'request_id': 'req-7315acbd-0734-4843-9f49-f8ce0991d203'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.309664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8410be155ae482c987dfeda4e5fb557', 'request_id': 'req-7315acbd-0734-4843-9f49-f8ce0991d203'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.335134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] The token cache is being invalidate because project d8410be155ae482c987dfeda4e5fb557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:37.335661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.336667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.339025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1018/2071] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:37 2022] DELETE /identity/v3/projects/d8410be155ae482c987dfeda4e5fb557 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:37.344228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:37.347672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:37.360712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:37.366044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd93-02c3-4115-978d-4cf9aa134c14 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:37.491442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:37.492111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:37.492387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:37.492699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] PATH_INFO: `/v3/users/120cd822e0a445cd814bc8fc444b0a83` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:37.493968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=120cd822e0a445cd814bc8fc444b0a83)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:37.496411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:37.568089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120cd822e0a445cd814bc8fc444b0a83'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.569241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120cd822e0a445cd814bc8fc444b0a83'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.582899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120cd822e0a445cd814bc8fc444b0a83'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.608414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120cd822e0a445cd814bc8fc444b0a83'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.622149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-59e7e039-229f-46a2-9ba9-c62ccba22b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120cd822e0a445cd814bc8fc444b0a83'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:37.634021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1054/2072] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:37 2022] DELETE /identity/v3/users/120cd822e0a445cd814bc8fc444b0a83 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:37.927625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:37.929806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:37.966493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315acbd-0734-4843-9f49-f8ce0991d203 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.092527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:38.106141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.106891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.107326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.108087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] PATH_INFO: `/v3/projects/8be8ff49362a4bdb8835589f8332ea57` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.111782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be8ff49362a4bdb8835589f8332ea57)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.114546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.200903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be8ff49362a4bdb8835589f8332ea57', 'request_id': 'req-1ac53492-4cb9-44f6-8502-a1e946552d1f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:38.207574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be8ff49362a4bdb8835589f8332ea57', 'request_id': 'req-1ac53492-4cb9-44f6-8502-a1e946552d1f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:38.215471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be8ff49362a4bdb8835589f8332ea57', 'request_id': 'req-1ac53492-4cb9-44f6-8502-a1e946552d1f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:38.232317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] The token cache is being invalidate because project 8be8ff49362a4bdb8835589f8332ea57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:38.232804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:38.233623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ac53492-4cb9-44f6-8502-a1e946552d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:38.235353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1019/2073] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:37 2022] DELETE /identity/v3/projects/8be8ff49362a4bdb8835589f8332ea57 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:38.241402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.241748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.242070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.265329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:38.268243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:38.345302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1055/2074] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:38.353684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.354153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.354474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.379141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:38.380578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:38.389469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1020/2075] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:38.394667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.408588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82906f-52c1-4843-96be-792de3a41d2a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.416907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.418050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.418741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.419224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.420404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:38.420966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.424209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.446044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1056/2076] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:38.450968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.461160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e872-caae-4ec0-af5a-5b49c3a541b4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.467312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.468252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.468535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.468837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.469505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.471481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.507985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1021/2077] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:38 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:38.513387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.525018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453daed-837e-4222-b4f7-1db90519e96d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.536305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:38.617706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.618326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.618641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.618972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.619986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.622892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.649683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1057/2078] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:38 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:38.656677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.668284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1fcb-52b4-4574-81da-fa5a531bcf73 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.673591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.674262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.674562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.674815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.675471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.677146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.689104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1022/2079] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:38.694623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.706308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befdb0c-1f4c-470c-850d-8987b24f01a6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.711441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6dfc9-23e6-401a-bb24-7a67f141e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.712072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6dfc9-23e6-401a-bb24-7a67f141e502 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.712338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6dfc9-23e6-401a-bb24-7a67f141e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.712602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6dfc9-23e6-401a-bb24-7a67f141e502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.713290 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6dfc9-23e6-401a-bb24-7a67f141e502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.715355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6dfc9-23e6-401a-bb24-7a67f141e502 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.728557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1058/2080] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:38.734215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.745838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff997e-3cc3-4d89-a3f2-7f1719c54cdc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:38.751758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:38.752561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.753015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.753337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] PATH_INFO: `/v3/projects/97e1a4c873db44dfa32cba416d86d07c/users/77b8e24fed4646d498371c685aa6719b/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.772478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e1a4c873db44dfa32cba416d86d07c, user_id=77b8e24fed4646d498371c685aa6719b, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:38.775417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:38.793719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1023/2081] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:38 2022] PUT /identity/v3/projects/97e1a4c873db44dfa32cba416d86d07c/users/77b8e24fed4646d498371c685aa6719b/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:38.806323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:38.806615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:38.806861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:38.846977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] MFA Rules not processed for user `77b8e24fed4646d498371c685aa6719b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:38.848495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:38.936865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1059/2082] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:38.949453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:38.951386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:39.023821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a50f9-d5b7-4d8e-bab6-4d31b4529f29 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:39.027916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899d36e-93b1-4085-ba83-f2f7f5debf0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:39.028552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899d36e-93b1-4085-ba83-f2f7f5debf0c service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:39.028854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899d36e-93b1-4085-ba83-f2f7f5debf0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:39.029313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899d36e-93b1-4085-ba83-f2f7f5debf0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:39.046190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899d36e-93b1-4085-ba83-f2f7f5debf0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:39.047718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899d36e-93b1-4085-ba83-f2f7f5debf0c service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:39.062670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1024/2083] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:39.086952 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:39.200844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0468-3313-4dbe-bf6a-e932c2b21b7c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:39.204555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:39.205554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:39.206007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:39.206683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] PATH_INFO: `/v3/users/77b8e24fed4646d498371c685aa6719b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:39.208179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b8e24fed4646d498371c685aa6719b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:39.210857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:39.260992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:39.330143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b8e24fed4646d498371c685aa6719b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:39.330875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b8e24fed4646d498371c685aa6719b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:39.343031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b8e24fed4646d498371c685aa6719b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:39.359852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b8e24fed4646d498371c685aa6719b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:39.368237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b8e24fed4646d498371c685aa6719b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:39.376090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1060/2084] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:39 2022] DELETE /identity/v3/users/77b8e24fed4646d498371c685aa6719b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:39.383862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:39.384590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:39.384933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:39.438141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:39.439839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:39.458616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:39.522056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1025/2085] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:39.536447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:39.538420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:39.610658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3025555-f0d8-470d-9a94-63342d7183f3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:39.615064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631262-3dec-4026-ace7-fdc99852675b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:39.615693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631262-3dec-4026-ace7-fdc99852675b service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:39.615971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631262-3dec-4026-ace7-fdc99852675b service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:39.616241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631262-3dec-4026-ace7-fdc99852675b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:39.627389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631262-3dec-4026-ace7-fdc99852675b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:39.628950 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631262-3dec-4026-ace7-fdc99852675b service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:39.640494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1061/2086] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:40.038605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.045306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:40.069598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd08924-0082-4f64-ada0-e6d3bb26c643 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.079738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.080860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.081496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.081968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] PATH_INFO: `/v3/projects/97e1a4c873db44dfa32cba416d86d07c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.083948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e1a4c873db44dfa32cba416d86d07c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.087558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.152394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e1a4c873db44dfa32cba416d86d07c', 'request_id': 'req-fa128902-85a0-4791-b971-7efc72cd607a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:40.159437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e1a4c873db44dfa32cba416d86d07c', 'request_id': 'req-fa128902-85a0-4791-b971-7efc72cd607a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:40.167313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e1a4c873db44dfa32cba416d86d07c', 'request_id': 'req-fa128902-85a0-4791-b971-7efc72cd607a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:40.183507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] The token cache is being invalidate because project 97e1a4c873db44dfa32cba416d86d07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:40.183859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:40.184701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-fa128902-85a0-4791-b971-7efc72cd607a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:40.186355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1026/2087] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:40 2022] DELETE /identity/v3/projects/97e1a4c873db44dfa32cba416d86d07c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:40.191828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.192148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.192545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.215104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:40.216839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:40.310629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1062/2088] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:40.321177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.321583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.321942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.354067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:40.356469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:40.366870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1027/2089] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:40.372945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.384609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126087f3-4ae0-40ff-8609-16e67bc84e8f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.391647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.392365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.392777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.393106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.393834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:40.394197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.396658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.412762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1063/2090] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:40.417736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.429264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054092d0-23ce-4bcd-9f77-ed19b55720ac None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.434878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.435512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.435789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.436064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.436748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.438693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.476333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1028/2091] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:40 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:40.483271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.504406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f6ba1-e6fa-48c9-8a9e-c7a2965fadf8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.559233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:40.607904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.608865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.609043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.609241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.609873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.612289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.658193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1064/2092] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:40 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:40.659176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.676792 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e746e6-ab34-49bc-a616-5032f780f0e2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.682888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.683815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.684657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.684977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.685681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.687424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.700795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1029/2093] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:24:40.705551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.719735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379093-c3be-4225-ac23-360cb6895197 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.727906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfb3e-a5b6-492f-8296-24b413bee98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.728861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfb3e-a5b6-492f-8296-24b413bee98b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.729507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfb3e-a5b6-492f-8296-24b413bee98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.729782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfb3e-a5b6-492f-8296-24b413bee98b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.735780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfb3e-a5b6-492f-8296-24b413bee98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.738708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfb3e-a5b6-492f-8296-24b413bee98b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.759419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1065/2094] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:24:40.765714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:40.780734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dfb0f-da14-4ed8-b6ea-6741c055bf58 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:40.785894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:40.786579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.786862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.787143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] PATH_INFO: `/v3/projects/38494b6647e84f44b70e71f635cf8b79/users/54a8a3fdec5d4410b5e20c617b29db92/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.806742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38494b6647e84f44b70e71f635cf8b79, user_id=54a8a3fdec5d4410b5e20c617b29db92, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:40.809896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:40.827688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1030/2095] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:40 2022] PUT /identity/v3/projects/38494b6647e84f44b70e71f635cf8b79/users/54a8a3fdec5d4410b5e20c617b29db92/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:40.839591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:40.839974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:40.840292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:40.881376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] MFA Rules not processed for user `54a8a3fdec5d4410b5e20c617b29db92`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:40.883397 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:41.001641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1066/2096] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:41.022495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:41.024962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:41.088250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:41.110744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898926a2-d514-4283-aaa7-28043b4beea6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:41.117291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7eab8-4b45-4d27-8fc1-9a400f4e337e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:41.118274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7eab8-4b45-4d27-8fc1-9a400f4e337e service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:41.118773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7eab8-4b45-4d27-8fc1-9a400f4e337e service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:41.119234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7eab8-4b45-4d27-8fc1-9a400f4e337e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:41.138850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7eab8-4b45-4d27-8fc1-9a400f4e337e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:41.140335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7eab8-4b45-4d27-8fc1-9a400f4e337e service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:41.152008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1031/2097] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:48.234099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:48.311581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4164377-dd07-4724-870e-5af0752e08c1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:48.316879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:48.317559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:48.317870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:48.318114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] PATH_INFO: `/v3/users/54a8a3fdec5d4410b5e20c617b29db92` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:48.320700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a8a3fdec5d4410b5e20c617b29db92)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:48.321496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:48.383625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:48.396851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a8a3fdec5d4410b5e20c617b29db92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:48.398121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a8a3fdec5d4410b5e20c617b29db92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:48.414199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a8a3fdec5d4410b5e20c617b29db92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:48.435707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a8a3fdec5d4410b5e20c617b29db92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:48.447132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a8a3fdec5d4410b5e20c617b29db92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:48.453905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1067/2098] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:48 2022] DELETE /identity/v3/users/54a8a3fdec5d4410b5e20c617b29db92 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:48.458927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:48.459590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:48.459590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:48.481754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:48.483310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:48.560287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1032/2099] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:48.575846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:48.577466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:48.661845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f10a-7cdb-456f-9cdd-631dcebc89f7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:48.666443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c389b-a424-40f9-9486-c6135ced357b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:48.667612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c389b-a424-40f9-9486-c6135ced357b service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:48.667911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c389b-a424-40f9-9486-c6135ced357b service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:48.668179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c389b-a424-40f9-9486-c6135ced357b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:48.680233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c389b-a424-40f9-9486-c6135ced357b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:48.682153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c389b-a424-40f9-9486-c6135ced357b service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:48.695683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1068/2100] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:49.053807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.056122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:49.078381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20a32c-94cf-4f0c-88a0-697d0c7acd1a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:49.088542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:49.089553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.089866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.090233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] PATH_INFO: `/v3/projects/38494b6647e84f44b70e71f635cf8b79` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.091566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38494b6647e84f44b70e71f635cf8b79)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:49.093778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:49.194980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38494b6647e84f44b70e71f635cf8b79', 'request_id': 'req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:49.213979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38494b6647e84f44b70e71f635cf8b79', 'request_id': 'req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:49.242309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38494b6647e84f44b70e71f635cf8b79', 'request_id': 'req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:49.268719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] The token cache is being invalidate because project 38494b6647e84f44b70e71f635cf8b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:49.269354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:49.270594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4aab3d0e-4c6a-4d8b-8a5c-0dd7f1cfe472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:49.273796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1033/2101] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:49 2022] DELETE /identity/v3/projects/38494b6647e84f44b70e71f635cf8b79 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:49.281476 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.282460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.282739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.311527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:49.313753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:49.448092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1069/2102] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:49.463201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.463925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.463925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.505026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:49.507279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:49.524738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1034/2103] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:49.531539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.545180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc6521-a34a-42b0-9495-e8d051782ae4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:49.550438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:49.551226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.551561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.551894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.552771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:49.553138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:49.555169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:49.578627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1070/2104] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:49.585739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.604333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed89f5-94ee-4540-8521-523698b211c1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:49.615499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:49.616582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.617032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.617524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.618691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:49.623354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:49.668875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1035/2105] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:49 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:49.673161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.696282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39159-fa02-44de-8147-fe0a5eb55373 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:49.774511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:49.815095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:49.816075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.816578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.817130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.818379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:49.822429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:49.864861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1071/2106] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:49 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:49.869747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.885901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df55c3-26bc-42dd-b333-ac83f4c2b970 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:49.891415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:49.892190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.892527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.892901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.893655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:49.896248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:49.911578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1036/2107] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:24:49.916581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.932457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e78de-1140-4008-9d30-fffef94d1d88 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:49.938713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e531f-a168-42c4-9836-06dc61eb2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:49.939676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e531f-a168-42c4-9836-06dc61eb2db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:49.940094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e531f-a168-42c4-9836-06dc61eb2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:49.940529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e531f-a168-42c4-9836-06dc61eb2db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:49.941747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e531f-a168-42c4-9836-06dc61eb2db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:49.949367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e531f-a168-42c4-9836-06dc61eb2db4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:49.970063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1072/2108] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:49.977889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:49.997634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34136a06-9047-4f54-897d-440c6bfef6eb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:50.005894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:50.007028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:50.007514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:50.008425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] PATH_INFO: `/v3/projects/e6316f8d0b8541439a036fd051ada969/users/e8aeb6bc269744ecb067fd095f42f0b9/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:50.038438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6316f8d0b8541439a036fd051ada969, user_id=e8aeb6bc269744ecb067fd095f42f0b9, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:50.044653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:50.073841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1037/2109] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:49 2022] PUT /identity/v3/projects/e6316f8d0b8541439a036fd051ada969/users/e8aeb6bc269744ecb067fd095f42f0b9/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:50.092531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c87b07-95b0-4e6c-bc7f-52a07a1aa8ec None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:50.093045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c87b07-95b0-4e6c-bc7f-52a07a1aa8ec None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:50.093400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c87b07-95b0-4e6c-bc7f-52a07a1aa8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:50.148205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-42c87b07-95b0-4e6c-bc7f-52a07a1aa8ec None None] MFA Rules not processed for user `e8aeb6bc269744ecb067fd095f42f0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:50.149536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-42c87b07-95b0-4e6c-bc7f-52a07a1aa8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:50.245857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1073/2110] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:50.260205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:50.262560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:50.268686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:50.345650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c9a1e-f80c-4ffc-bb82-227c6305ad4a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:50.356398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:50.358529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:50.358529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:50.359335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:50.381653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:50.383322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:50.395356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1038/2111] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:53.367112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:53.367788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:53.367788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:53.395266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:53.397431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:53.476132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1074/2112] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:53.513428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:53.515317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:53.605903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d58179-e718-4781-80d4-085a58ea5e0b service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:53.613194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b8346-a6b1-4085-91c9-50a1a15f8a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:53.613853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8346-a6b1-4085-91c9-50a1a15f8a82 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:53.614154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8346-a6b1-4085-91c9-50a1a15f8a82 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:53.614535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8346-a6b1-4085-91c9-50a1a15f8a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:53.625703 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8346-a6b1-4085-91c9-50a1a15f8a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:53.627281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b8346-a6b1-4085-91c9-50a1a15f8a82 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:53.641071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1039/2113] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:54.170868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:54.181786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b615696-a61f-4016-a95b-85519ca7b6f0 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:54.188048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:54.188742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:54.189009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:54.189352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] PATH_INFO: `/v3/users/e8aeb6bc269744ecb067fd095f42f0b9` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:54.190697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8aeb6bc269744ecb067fd095f42f0b9)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:54.192863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:54.253532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8aeb6bc269744ecb067fd095f42f0b9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:54.254132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8aeb6bc269744ecb067fd095f42f0b9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:54.257140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:54.265707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8aeb6bc269744ecb067fd095f42f0b9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:54.292027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8aeb6bc269744ecb067fd095f42f0b9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:54.306337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8aeb6bc269744ecb067fd095f42f0b9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:54.318464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1075/2114] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:24:54 2022] DELETE /identity/v3/users/e8aeb6bc269744ecb067fd095f42f0b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:54.324707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:54.325241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:54.325681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:54.358743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:54.360988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:54.435969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1040/2115] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:24:54.449268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:54.451162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:54.534895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c395942-4d1d-43f7-8356-d4b49420f484 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:54.539588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3021884-4efb-441b-b035-687f120f2771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:54.540239 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3021884-4efb-441b-b035-687f120f2771 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:54.540542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3021884-4efb-441b-b035-687f120f2771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:54.540763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3021884-4efb-441b-b035-687f120f2771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:54.552954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3021884-4efb-441b-b035-687f120f2771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:54.554453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3021884-4efb-441b-b035-687f120f2771 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:54.566754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1076/2116] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:24:54.900296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:54.903003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:54.917875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bac62-5d6f-47c6-8e7f-e4212f9c74cf None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:54.931059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:54.931872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:54.932260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:54.932750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] PATH_INFO: `/v3/projects/e6316f8d0b8541439a036fd051ada969` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:54.934199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6316f8d0b8541439a036fd051ada969)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:54.936350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:54.979900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:55.012049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6316f8d0b8541439a036fd051ada969', 'request_id': 'req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:55.022545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6316f8d0b8541439a036fd051ada969', 'request_id': 'req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:55.037100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6316f8d0b8541439a036fd051ada969', 'request_id': 'req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:55.055244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] The token cache is being invalidate because project e6316f8d0b8541439a036fd051ada969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:24:55.055549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:55.056445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-56af7b73-00f7-4fd1-b8c5-1ccd01bb12cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:24:55.058915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1041/2117] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:24:54 2022] DELETE /identity/v3/projects/e6316f8d0b8541439a036fd051ada969 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:55.064175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.064482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.064809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.094174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:55.095493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:55.209784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1077/2118] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:55.218427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.218863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.219336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.247062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:55.248423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:55.257430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1042/2119] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:55.262983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.275236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb879-0816-4334-b2ae-55bcf1ddace6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.281307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.281868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.282142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.282408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.283240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:24:55.283387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.285054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:55.299750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1078/2120] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:24:55.304492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.314439 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e470-29a5-40f4-ae51-23bfa1d39052 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.319264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.319899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.320178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.320451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.321170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.323298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:55.357205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1043/2121] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:55.362158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.374084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aace4-09f1-4ae9-9b25-bd3ad0c7b80c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.433583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:55.443032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.443917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.444205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.444505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.445213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.447495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:55.474235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1079/2122] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:55 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:55.479365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.492104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890fa1-b622-4538-a0d7-795600f1551b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.499939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.501142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.501608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.502139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.503389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.506584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:55.527736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1044/2123] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:55.534703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.554598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b466c0-031b-4bab-9efc-04a97adcdd5b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.563692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7feb-6e09-45ec-9a05-6124d30bf110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.564859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7feb-6e09-45ec-9a05-6124d30bf110 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.565284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7feb-6e09-45ec-9a05-6124d30bf110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.565754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7feb-6e09-45ec-9a05-6124d30bf110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.566911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d7feb-6e09-45ec-9a05-6124d30bf110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.569966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d7feb-6e09-45ec-9a05-6124d30bf110 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:55.595846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1080/2124] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:55.597354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.612664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e29d6-5340-461b-9a60-99ad525e8fc2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.622689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.623886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.624388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.624920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] PATH_INFO: `/v3/projects/48771055d9f749aba3307cb334deba4e/users/13dd685b571b4bccba2edd2b4fadecd4/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.650582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48771055d9f749aba3307cb334deba4e, user_id=13dd685b571b4bccba2edd2b4fadecd4, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.654656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:55.679407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1045/2125] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:55 2022] PUT /identity/v3/projects/48771055d9f749aba3307cb334deba4e/users/13dd685b571b4bccba2edd2b4fadecd4/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:55.699211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.700305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.700796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.739743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] MFA Rules not processed for user `13dd685b571b4bccba2edd2b4fadecd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:55.741940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:55.861976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1081/2126] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:55.868825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:55.969265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f54e79-3bc5-49a2-88d0-8a63df46fb94 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:55.974265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:55.974903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:55.975178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:55.975450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:55.976102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:55.978157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.013657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1046/2127] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:55 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:56.018679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.043088 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac3e0f-d853-43e7-a876-83f9f162d04a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.151069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.151882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.152164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.152530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.153321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.155384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.183226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1082/2128] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:56 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:24:56.189912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.203222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0f682-fda4-494a-aa5d-973e441aa4b3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.212164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.212958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.213820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.214476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.215194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.217018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.229973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1047/2129] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:56.238646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.252434 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de3a04-70b6-4703-95bd-ade2f7568b31 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.260122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c849014-22b7-4d0f-a100-f761d4a0aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.261117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c849014-22b7-4d0f-a100-f761d4a0aca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.261117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c849014-22b7-4d0f-a100-f761d4a0aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.261403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c849014-22b7-4d0f-a100-f761d4a0aca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.262046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c849014-22b7-4d0f-a100-f761d4a0aca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.263697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c849014-22b7-4d0f-a100-f761d4a0aca5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.275186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1083/2130] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:56.280573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.298510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4cd1a-e67b-4fbb-a686-fa2290ccfd0a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.303953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.307236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.307236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.307236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] PATH_INFO: `/v3/projects/4899455dc2f94751a12496767cb0de19/users/b9db777482e94c70b52ea7d14ea9bc14/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.325962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4899455dc2f94751a12496767cb0de19, user_id=b9db777482e94c70b52ea7d14ea9bc14, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.329182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.364458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1048/2131] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:56 2022] PUT /identity/v3/projects/4899455dc2f94751a12496767cb0de19/users/b9db777482e94c70b52ea7d14ea9bc14/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:56.364458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:56.377964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.378595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.379171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.418560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] MFA Rules not processed for user `b9db777482e94c70b52ea7d14ea9bc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:56.419705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:56.459538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:56.518777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1084/2132] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:56.520421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.613262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212deb-2fdd-4b3f-8dbd-19485e511eff admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.617966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.618599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.618877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.619144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.619796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.622623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.654645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1049/2133] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:24:56 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:56.659075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.671399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36682-6e97-46f6-8e66-ad4ece9020fb None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.741375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.742188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.742462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.742727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.743379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.745748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.770423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1085/2134] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:24:56 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:24:56.774803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.787528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bc14a-43e0-4292-91d0-e3f34ee5fc3b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.793619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.794257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.794531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.794796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.795450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.797457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.809947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1050/2135] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:56.816457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.833988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32c61a-205b-411f-9cf2-329f230b592e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.839939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.840737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.841065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.841379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] PATH_INFO: `/v3/projects/c6cef5fd7f4c43b2bd5f6e48c29a7570/users/f34cefa1e2ae4d3f8ba05c9a364912a0/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.861537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cef5fd7f4c43b2bd5f6e48c29a7570, user_id=f34cefa1e2ae4d3f8ba05c9a364912a0, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.864494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:56.883144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1086/2136] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:56 2022] PUT /identity/v3/projects/c6cef5fd7f4c43b2bd5f6e48c29a7570/users/f34cefa1e2ae4d3f8ba05c9a364912a0/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:56.888032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:56.902683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8284ee-e1ed-4812-87fa-a6188ed04714 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:56.992161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ba410-d714-4cf5-86e8-b464c344d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:56.993244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ba410-d714-4cf5-86e8-b464c344d4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:56.993244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ba410-d714-4cf5-86e8-b464c344d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:56.993649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ba410-d714-4cf5-86e8-b464c344d4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:56.994235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ba410-d714-4cf5-86e8-b464c344d4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:56.996532 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ba410-d714-4cf5-86e8-b464c344d4bb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:57.008149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1051/2137] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:24:57.015983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:57.031404 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c910b-ecd3-4b6f-b470-7db0857b0847 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:57.038205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:57.039032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:57.039421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:57.039781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] PATH_INFO: `/v3/projects/c6cef5fd7f4c43b2bd5f6e48c29a7570/users/f34cefa1e2ae4d3f8ba05c9a364912a0/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:57.042531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cef5fd7f4c43b2bd5f6e48c29a7570, user_id=f34cefa1e2ae4d3f8ba05c9a364912a0, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:57.045364 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:57.058513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1087/2138] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:24:57 2022] PUT /identity/v3/projects/c6cef5fd7f4c43b2bd5f6e48c29a7570/users/f34cefa1e2ae4d3f8ba05c9a364912a0/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:24:57.069609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:57.069841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:57.070148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:57.105338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] MFA Rules not processed for user `f34cefa1e2ae4d3f8ba05c9a364912a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:24:57.106664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:57.182838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:57.193594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1052/2139] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:24:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:24:57.206596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:57.208793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:24:57.298232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd8891-70a3-496e-b57f-b46bd37f6c3f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:57.302360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:57.303004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:57.303279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:57.303552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:57.352332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:57.374115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:57.375655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:57.386309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1088/2140] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:24:59.148535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:24:59.160448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4976373-0e77-4044-8eaa-3308033e0dba None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:24:59.167476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61989820-f9e2-41aa-9d6d-7d4479a40da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:24:59.168427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989820-f9e2-41aa-9d6d-7d4479a40da7 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:24:59.168981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989820-f9e2-41aa-9d6d-7d4479a40da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:24:59.169655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989820-f9e2-41aa-9d6d-7d4479a40da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:24:59.274265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61989820-f9e2-41aa-9d6d-7d4479a40da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:24:59.275759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61989820-f9e2-41aa-9d6d-7d4479a40da7 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:24:59.286428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1053/2141] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:24:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:00.318256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:00.328570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eb150-2586-4085-8ce7-d7ba4f7d2863 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:00.333704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889d891-a030-4b49-ab54-9aa6acc5ce1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:00.334538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d891-a030-4b49-ab54-9aa6acc5ce1e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:00.335058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d891-a030-4b49-ab54-9aa6acc5ce1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:00.335389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d891-a030-4b49-ab54-9aa6acc5ce1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:00.348719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d891-a030-4b49-ab54-9aa6acc5ce1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:00.350857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d891-a030-4b49-ab54-9aa6acc5ce1e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:00.365809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1089/2142] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:01.045263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:01.046111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:01.047450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:01.083254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:01.084772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:01.214609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:01.215455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:01.216136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:01.218670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1054/2143] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:01.248461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:01.251055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:01.255330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:01.263948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:01.384537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1090/2144] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:25:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:25:01.390551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98a23-3948-4bfe-a12d-52590719670f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:01.401959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269a502-ccb9-44af-8371-18eab339adac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:01.403137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269a502-ccb9-44af-8371-18eab339adac service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:01.403603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269a502-ccb9-44af-8371-18eab339adac service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:01.404399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269a502-ccb9-44af-8371-18eab339adac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:01.419144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269a502-ccb9-44af-8371-18eab339adac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:01.422342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269a502-ccb9-44af-8371-18eab339adac service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:01.443814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:01.444835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1055/2145] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:25:01.445997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:01.593396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686f6f5-df80-4f36-b3d2-20d82b56d4f7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:01.609437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:01.610681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:01.610970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:01.611223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:01.633542 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:01.635716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:01.653119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1091/2146] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:25:02.685335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561985f-3523-4abd-a24e-ba2706eaba99 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:02.685867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561985f-3523-4abd-a24e-ba2706eaba99 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:02.685867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561985f-3523-4abd-a24e-ba2706eaba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:02.707467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7561985f-3523-4abd-a24e-ba2706eaba99 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:02.708802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7561985f-3523-4abd-a24e-ba2706eaba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:02.717868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1056/2147] 10.222.0.57 () {58 vars in 967 bytes} [Thu Sep 1 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:02.733193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:02.746007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6c39-9a35-4eb9-802a-6799a0c6bf63 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:02.753282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd30106-a060-4fa0-b4d4-1fd223a26d24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:02.753907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd30106-a060-4fa0-b4d4-1fd223a26d24 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:02.754189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd30106-a060-4fa0-b4d4-1fd223a26d24 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:02.755052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd30106-a060-4fa0-b4d4-1fd223a26d24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:02.769860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd30106-a060-4fa0-b4d4-1fd223a26d24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:02.771493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd30106-a060-4fa0-b4d4-1fd223a26d24 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:02.781721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1092/2148] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:25:02.871852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:02.872171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:02.872408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:02.894484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] MFA Rules not processed for user `c53e53ea051c4594b6c84f4ae58ac43f`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:02.895828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:02.906335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:02.981395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1057/2149] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:03.091422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae36037-4146-49c1-a1f7-340c929ff633 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:03.091687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae36037-4146-49c1-a1f7-340c929ff633 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:03.092011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae36037-4146-49c1-a1f7-340c929ff633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:03.113398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2ae36037-4146-49c1-a1f7-340c929ff633 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:03.114697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2ae36037-4146-49c1-a1f7-340c929ff633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:03.124955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1093/2150] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:25:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:25:03.142204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:03.158165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242a2a-3321-4442-92cb-162d8662ce1b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:03.167671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:03.168699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:03.169173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:03.169638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:03.185353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:03.188222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:03.205466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1058/2151] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:25:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:25:03.853031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98669142-5088-4271-8991-bbd1590f5504 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:03.853629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98669142-5088-4271-8991-bbd1590f5504 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:03.853844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98669142-5088-4271-8991-bbd1590f5504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:03.886818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-98669142-5088-4271-8991-bbd1590f5504 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:03.888965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-98669142-5088-4271-8991-bbd1590f5504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:03.900877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1094/2152] 10.222.0.57 () {58 vars in 967 bytes} [Thu Sep 1 05:25:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:25:03.920283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:03.997764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2b83-3901-42eb-aeca-f53ca05bf17c service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:04.023562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57cd7-d966-4689-aadf-5758a878ecb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:04.027122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57cd7-d966-4689-aadf-5758a878ecb3 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:04.027660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57cd7-d966-4689-aadf-5758a878ecb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:04.032983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57cd7-d966-4689-aadf-5758a878ecb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:04.077406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57cd7-d966-4689-aadf-5758a878ecb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:04.081035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57cd7-d966-4689-aadf-5758a878ecb3 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:04.111183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1059/2153] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:25:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:25:05.109764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98669142-5088-4271-8991-bbd1590f5504 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:05.141455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98669142-5088-4271-8991-bbd1590f5504 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:05.154122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:05.154652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:05.154926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:05.155372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] PATH_INFO: `/v3/users/13dd685b571b4bccba2edd2b4fadecd4` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:05.156937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dd685b571b4bccba2edd2b4fadecd4)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:05.159264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:05.231058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:05.271255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dd685b571b4bccba2edd2b4fadecd4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:05.272123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dd685b571b4bccba2edd2b4fadecd4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:05.290278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dd685b571b4bccba2edd2b4fadecd4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:05.322506 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dd685b571b4bccba2edd2b4fadecd4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:05.346064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dd685b571b4bccba2edd2b4fadecd4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:05.362508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1095/2154] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:25:05 2022] DELETE /identity/v3/users/13dd685b571b4bccba2edd2b4fadecd4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:05.369617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f248ed-a559-426f-887e-8764b21baf72 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:05.371650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f248ed-a559-426f-887e-8764b21baf72 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:05.372402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f248ed-a559-426f-887e-8764b21baf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:05.407678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d7f248ed-a559-426f-887e-8764b21baf72 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:05.410580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d7f248ed-a559-426f-887e-8764b21baf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:05.575512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1060/2155] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:05.584032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:05.588083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:05.661457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:05.662170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:05.662793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:05.701340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:05.703883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:05.719979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1061/2156] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:05.742767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c42d2-841a-4c40-94e3-73c54a59c690 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:05.747973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:05.750057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:05.750620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:05.751017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:05.751465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:05.751917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:05.779137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:05.783238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:05.808970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1096/2157] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:25:05.954491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9179d4e-dff9-4875-b74a-473a608d4dc8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:05.985616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:05.987817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:05.989611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:05.990445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:06.023222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:06.027074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:06.059351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1062/2158] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:06.528408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:06.530826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:06.550896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35bdd-e55d-49f4-8531-6e410fbcd1fa service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:06.558670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:06.559680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:06.560381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:06.561087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] PATH_INFO: `/v3/projects/48771055d9f749aba3307cb334deba4e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:06.563395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48771055d9f749aba3307cb334deba4e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:06.569692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:06.643319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48771055d9f749aba3307cb334deba4e', 'request_id': 'req-cbb1da52-3383-4a9c-aac3-ccea598349f2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.655662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48771055d9f749aba3307cb334deba4e', 'request_id': 'req-cbb1da52-3383-4a9c-aac3-ccea598349f2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.668376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48771055d9f749aba3307cb334deba4e', 'request_id': 'req-cbb1da52-3383-4a9c-aac3-ccea598349f2'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.687250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] The token cache is being invalidate because project 48771055d9f749aba3307cb334deba4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:25:06.687574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.688319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.690158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1097/2159] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:25:06 2022] DELETE /identity/v3/projects/48771055d9f749aba3307cb334deba4e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:06.695280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:06.710541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327248-fc0d-498a-b370-94310edfabe7 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:06.722807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:06.803234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:06.804300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:06.804800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:06.805285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] PATH_INFO: `/v3/users/b9db777482e94c70b52ea7d14ea9bc14` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:06.807435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9db777482e94c70b52ea7d14ea9bc14)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:06.811088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:06.897812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9db777482e94c70b52ea7d14ea9bc14'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.910869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9db777482e94c70b52ea7d14ea9bc14'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.911723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9db777482e94c70b52ea7d14ea9bc14'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.932790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9db777482e94c70b52ea7d14ea9bc14'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.942656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9db777482e94c70b52ea7d14ea9bc14'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:06.951541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1063/2160] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:25:06 2022] DELETE /identity/v3/users/b9db777482e94c70b52ea7d14ea9bc14 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:07.165420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:07.167694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:07.185687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1da52-3383-4a9c-aac3-ccea598349f2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:07.233425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:07.297908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:07.299092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:07.299789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:07.300440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] PATH_INFO: `/v3/users/11b81f4af3d74843ada0a9315d12d037` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:07.302061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b81f4af3d74843ada0a9315d12d037)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:07.304677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:07.403445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b81f4af3d74843ada0a9315d12d037'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.404732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b81f4af3d74843ada0a9315d12d037'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.420934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b81f4af3d74843ada0a9315d12d037'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.446777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b81f4af3d74843ada0a9315d12d037'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.460378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-14a23ed2-64ed-4c22-b8bf-d992fd6e36c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b81f4af3d74843ada0a9315d12d037'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.467540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:07.470496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:07.477872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1098/2161] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:25:07 2022] DELETE /identity/v3/users/11b81f4af3d74843ada0a9315d12d037 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:07.487361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:07.487844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:07.488352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:07.501890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063195e-da5d-4f45-8ca2-c31fdb130072 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:07.532322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:07.534731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:07.622074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:07.623453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:07.624086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:07.624369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] PATH_INFO: `/v3/projects/4899455dc2f94751a12496767cb0de19` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:07.627087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4899455dc2f94751a12496767cb0de19)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:07.629162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:07.677316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1099/2162] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:07.680807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:07.693235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:07.696668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:07.706293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4899455dc2f94751a12496767cb0de19', 'request_id': 'req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.715140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4899455dc2f94751a12496767cb0de19', 'request_id': 'req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.723412 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4899455dc2f94751a12496767cb0de19', 'request_id': 'req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.745013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] The token cache is being invalidate because project 4899455dc2f94751a12496767cb0de19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:25:07.745842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.747249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:07.750220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1064/2163] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:25:07 2022] DELETE /identity/v3/projects/4899455dc2f94751a12496767cb0de19 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:07.755735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:07.758200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:07.802145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d5587-62f7-4260-b47c-c631eec04b42 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:07.812091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:07.888789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff46a44-8409-4aa2-a600-c05dfb62a0f8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:07.894862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:07.895283 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:07.895780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:07.895953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:07.896203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:07.896504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:07.896717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] PATH_INFO: `/v3/users/f34cefa1e2ae4d3f8ba05c9a364912a0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:07.897019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:07.897919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34cefa1e2ae4d3f8ba05c9a364912a0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:07.900309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:07.900490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:07.927809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:07.934236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:07.959327 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1100/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:08.007606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34cefa1e2ae4d3f8ba05c9a364912a0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.021846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34cefa1e2ae4d3f8ba05c9a364912a0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.024084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34cefa1e2ae4d3f8ba05c9a364912a0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.055931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34cefa1e2ae4d3f8ba05c9a364912a0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.073195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34cefa1e2ae4d3f8ba05c9a364912a0'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.083406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1065/2165] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:25:07 2022] DELETE /identity/v3/users/f34cefa1e2ae4d3f8ba05c9a364912a0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:08.298480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:08.304207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:08.336592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb9b3-52b4-48d8-a430-58500c37e09c service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:08.525664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:08.526715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:08.527171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:08.527625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] PATH_INFO: `/v3/projects/90b821867cf7485397b8e93234ca2df7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:08.531138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b821867cf7485397b8e93234ca2df7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:08.538255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:08.641410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b821867cf7485397b8e93234ca2df7', 'request_id': 'req-2409fbff-4d0a-4e73-b051-89d750f78132'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.649507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:08.653437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:08.658683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b821867cf7485397b8e93234ca2df7', 'request_id': 'req-2409fbff-4d0a-4e73-b051-89d750f78132'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.672895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b821867cf7485397b8e93234ca2df7', 'request_id': 'req-2409fbff-4d0a-4e73-b051-89d750f78132'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.694961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] The token cache is being invalidate because project 90b821867cf7485397b8e93234ca2df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:25:08.695359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.696502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2409fbff-4d0a-4e73-b051-89d750f78132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.699016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1101/2166] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:25:08 2022] DELETE /identity/v3/projects/90b821867cf7485397b8e93234ca2df7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:08.701779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86532ad-e524-4df0-8160-57b7cdee4d22 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:08.705304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97133cc-8bd3-4f7e-b50d-16f4e65b3a25 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:08.705763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97133cc-8bd3-4f7e-b50d-16f4e65b3a25 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:08.706514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97133cc-8bd3-4f7e-b50d-16f4e65b3a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:08.749491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d97133cc-8bd3-4f7e-b50d-16f4e65b3a25 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:08.751479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d97133cc-8bd3-4f7e-b50d-16f4e65b3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:08.760714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:08.790455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:08.791413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:08.791860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:08.792698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] PATH_INFO: `/v3/projects/c6cef5fd7f4c43b2bd5f6e48c29a7570` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:08.794079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cef5fd7f4c43b2bd5f6e48c29a7570)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:08.796460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:08.820053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:08.864209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1102/2167] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:25:08.868854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cef5fd7f4c43b2bd5f6e48c29a7570', 'request_id': 'req-1986c967-c3c5-4f8e-98b1-50e587f5deba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.874127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:08.874739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:08.874739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:08.877402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cef5fd7f4c43b2bd5f6e48c29a7570', 'request_id': 'req-1986c967-c3c5-4f8e-98b1-50e587f5deba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.887454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cef5fd7f4c43b2bd5f6e48c29a7570', 'request_id': 'req-1986c967-c3c5-4f8e-98b1-50e587f5deba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.898838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:08.899930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:08.910897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] The token cache is being invalidate because project c6cef5fd7f4c43b2bd5f6e48c29a7570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:25:08.911583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.912784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:08.915518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1066/2168] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:25:08 2022] DELETE /identity/v3/projects/c6cef5fd7f4c43b2bd5f6e48c29a7570 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:08.975814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1103/2169] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:25:08.983548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.003616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c967-c3c5-4f8e-98b1-50e587f5deba admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.011878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.013011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.013481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.013955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.015223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:25:09.016154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.019288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.051027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1067/2170] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:25:09.060685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.076801 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc517a-1892-4488-ab8f-2b0ba680d77d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.084681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.085672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.086114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.086553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.087668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.091696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.151546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1104/2171] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:25:09 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:25:09.154902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.177249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818053a5-1723-42bf-9af7-d7a3086eee50 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.271663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.272684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.273146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.273594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.274376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.277438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.325777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1068/2172] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:25:09 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:25:09.332009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.356492 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172f0b-2399-44a7-b0b1-e92fead9746a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.365969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.367334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.367811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.368483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.371187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.374375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.396697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1105/2173] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:25:09.403785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.423619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed009-5328-428d-b811-e76cf2434111 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.431734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6ad5c-8334-4d54-bfd5-d06b6bc982ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.432829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6ad5c-8334-4d54-bfd5-d06b6bc982ee admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.433289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6ad5c-8334-4d54-bfd5-d06b6bc982ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.433733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6ad5c-8334-4d54-bfd5-d06b6bc982ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.436194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6ad5c-8334-4d54-bfd5-d06b6bc982ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.438123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6ad5c-8334-4d54-bfd5-d06b6bc982ee admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.465691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1069/2174] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:25:09.466509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.489672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64632e-6926-427a-b95a-658c8884ca65 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.502733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.504259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.504880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.505420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] PATH_INFO: `/v3/projects/ed924b87f4e9436e839864821263bec8/users/432e309be58d499e832e7ea40232257e/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.543846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed924b87f4e9436e839864821263bec8, user_id=432e309be58d499e832e7ea40232257e, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.548554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.593491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1106/2175] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:25:09 2022] PUT /identity/v3/projects/ed924b87f4e9436e839864821263bec8/users/432e309be58d499e832e7ea40232257e/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:25:09.599912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c7eb4-99df-436a-9d29-51372a5ecce0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.600270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c7eb4-99df-436a-9d29-51372a5ecce0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.601573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c7eb4-99df-436a-9d29-51372a5ecce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.640832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-727c7eb4-99df-436a-9d29-51372a5ecce0 None None] MFA Rules not processed for user `432e309be58d499e832e7ea40232257e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:09.642408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-727c7eb4-99df-436a-9d29-51372a5ecce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:09.677523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:09.746917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1070/2176] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:09.763040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:09.765387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:09.882341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8881-06cb-41e3-81f9-1e834a83d8b6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:09.891809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:09.891809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.891809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.891809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.903085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49cff5-c056-49d3-9ce2-d0bdcafdb367 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:09.903940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49cff5-c056-49d3-9ce2-d0bdcafdb367 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:09.904133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49cff5-c056-49d3-9ce2-d0bdcafdb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:09.908990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:09.911793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:09.933246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1e49cff5-c056-49d3-9ce2-d0bdcafdb367 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:09.934861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1e49cff5-c056-49d3-9ce2-d0bdcafdb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:09.939346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1107/2177] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:25:10.038159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1071/2178] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:25:10.065591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:10.067997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:10.132593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:10.199435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af2861-85e0-4bd6-84d8-ac50ecd035ba service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:10.207269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:10.208155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:10.208666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:10.208904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:10.222811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:10.225038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:10.239195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1108/2179] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:17.322076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:17.322783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:17.322783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:17.346223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:17.347458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:17.357560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1072/2180] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:17.392582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:17.394211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:17.409925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5d3b-d041-4865-b3c9-922c347b793a service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:17.416214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43796-12c6-4a14-b328-47fe4e90d316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:17.416932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43796-12c6-4a14-b328-47fe4e90d316 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:17.417207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43796-12c6-4a14-b328-47fe4e90d316 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:17.417479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43796-12c6-4a14-b328-47fe4e90d316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:17.428943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba43796-12c6-4a14-b328-47fe4e90d316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:17.430997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba43796-12c6-4a14-b328-47fe4e90d316 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:17.443817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1109/2181] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:21.041883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:21.053519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424da3-8d00-4662-99b2-dddd401ce55c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:21.059890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:21.060565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:21.060939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:21.061218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] PATH_INFO: `/v3/users/432e309be58d499e832e7ea40232257e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:21.062612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432e309be58d499e832e7ea40232257e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:21.064710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:21.126053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432e309be58d499e832e7ea40232257e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.136599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432e309be58d499e832e7ea40232257e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.137715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432e309be58d499e832e7ea40232257e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.154789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432e309be58d499e832e7ea40232257e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.164768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432e309be58d499e832e7ea40232257e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.171723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1073/2182] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:25:21 2022] DELETE /identity/v3/users/432e309be58d499e832e7ea40232257e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:21.176882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:21.177429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:21.177524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:21.200793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:21.202101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:21.272841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1110/2183] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:21.284483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:21.286032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:21.326941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:21.356836 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6edde7-476d-46ca-b08a-afe8e8222953 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:21.361354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d57f8-e939-48b3-bf72-af49103e0e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:21.361991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d57f8-e939-48b3-bf72-af49103e0e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:21.362274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d57f8-e939-48b3-bf72-af49103e0e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:21.362561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d57f8-e939-48b3-bf72-af49103e0e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:21.375176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d57f8-e939-48b3-bf72-af49103e0e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:21.376685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d57f8-e939-48b3-bf72-af49103e0e98 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:21.390219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1074/2184] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:21.730774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:21.732458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:21.753378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e21a6-e938-4a6e-8b26-7bc6d537ddbf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:21.762215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:21.763237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:21.763771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:21.764188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] PATH_INFO: `/v3/projects/ed924b87f4e9436e839864821263bec8` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:21.766653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed924b87f4e9436e839864821263bec8)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:21.771035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:21.862526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed924b87f4e9436e839864821263bec8', 'request_id': 'req-137551dd-5ed7-4020-b2d9-3d456a4440da'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.870766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed924b87f4e9436e839864821263bec8', 'request_id': 'req-137551dd-5ed7-4020-b2d9-3d456a4440da'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.882384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed924b87f4e9436e839864821263bec8', 'request_id': 'req-137551dd-5ed7-4020-b2d9-3d456a4440da'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.898701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] The token cache is being invalidate because project ed924b87f4e9436e839864821263bec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:25:21.899145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.900929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:25:21.902923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1111/2185] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:25:21 2022] DELETE /identity/v3/projects/ed924b87f4e9436e839864821263bec8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:25:22.601672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:22.602244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:22.602244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:22.624461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:22.625753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:22.706045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1075/2186] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:22.731255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:22.732795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:22.778569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:22.854891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137551dd-5ed7-4020-b2d9-3d456a4440da admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:22.863721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768b5d3-a1a2-484b-9b02-3b3b7d0236c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:22.864888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b5d3-a1a2-484b-9b02-3b3b7d0236c7 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:22.865389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b5d3-a1a2-484b-9b02-3b3b7d0236c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:22.865894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b5d3-a1a2-484b-9b02-3b3b7d0236c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:22.882072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768b5d3-a1a2-484b-9b02-3b3b7d0236c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:22.885259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768b5d3-a1a2-484b-9b02-3b3b7d0236c7 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:22.904140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1112/2187] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:32.696416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=39 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:32.895435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=23 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:35.568933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:25:35.572790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:35.706431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761526-2f2b-4c36-8907-942b1a377105 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:25:35.714753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:25:35.715805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:35.716288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:35.716819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:35.720460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:35.737187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:25:35.738883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af94e1-f679-4c35-9c4e-b41b4b8aacb6 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:25:35.750359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1076/2188] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:25:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:25:40.556658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c0e26-29db-46ce-9f0f-cd1384dcd52d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:40.557621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c0e26-29db-46ce-9f0f-cd1384dcd52d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:40.558305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c0e26-29db-46ce-9f0f-cd1384dcd52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:40.584102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8a9c0e26-29db-46ce-9f0f-cd1384dcd52d None None] MFA Rules not processed for user `ae2819090d7b49dd931c705251e9fc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:40.585484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8a9c0e26-29db-46ce-9f0f-cd1384dcd52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:40.709417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1113/2189] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:45.267723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:25:45.268991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:25:45.269631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:25:45.299827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] MFA Rules not processed for user `8c8ad3919d764781a90420e48c65df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:25:45.301113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:25:45.411450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1077/2190] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:25:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:25:50.699083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=25 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:55.398995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=57 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:03.199359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6cf1-4b98-4d97-898f-c9e4982347cc None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:03.200041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6cf1-4b98-4d97-898f-c9e4982347cc None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:03.200041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe6cf1-4b98-4d97-898f-c9e4982347cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:03.223934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-fbfe6cf1-4b98-4d97-898f-c9e4982347cc None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:03.225266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fbfe6cf1-4b98-4d97-898f-c9e4982347cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:03.238540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1114/2191] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:03.274714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:03.292524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e334b2-d670-4848-a03f-6a157741b335 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:03.300671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:03.301467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:03.301775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:03.302258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:03.313590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:03.315242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:03.326778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1078/2192] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:26:08.654668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616c84a-3a55-4d3b-900d-15dcbcc8a99d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:08.655277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616c84a-3a55-4d3b-900d-15dcbcc8a99d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:08.655391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616c84a-3a55-4d3b-900d-15dcbcc8a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:08.676647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d616c84a-3a55-4d3b-900d-15dcbcc8a99d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:08.677922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d616c84a-3a55-4d3b-900d-15dcbcc8a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:08.686749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1115/2193] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:08.712128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:08.723989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bb1b9-e033-4f5b-8a2f-4de82f53d9a3 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:08.730443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:08.731063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:08.731339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:08.731605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:08.740914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:08.742737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:08.753473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1079/2194] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:12.677004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb76ef-620c-4360-9b94-3d56cedf062c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:12.677876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb76ef-620c-4360-9b94-3d56cedf062c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:12.677876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb76ef-620c-4360-9b94-3d56cedf062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:12.701165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-79eb76ef-620c-4360-9b94-3d56cedf062c None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:12.702728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-79eb76ef-620c-4360-9b94-3d56cedf062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:12.770390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1116/2195] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:12.834679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:12.837845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:12.935147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a02927-0826-41df-afe2-12a66da69be5 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:12.941978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:12.942661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:12.942955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:12.943236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:12.954161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:12.956122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:12.967424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1080/2196] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:26:13.889636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07e7ab-3e1d-4548-b220-31248cc57f89 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:13.891413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07e7ab-3e1d-4548-b220-31248cc57f89 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:13.892224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07e7ab-3e1d-4548-b220-31248cc57f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:13.936826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-cc07e7ab-3e1d-4548-b220-31248cc57f89 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:13.939140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cc07e7ab-3e1d-4548-b220-31248cc57f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:13.954058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1117/2197] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:13.981583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:14.005335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf046-2306-4896-bcd9-cb5b71abcb5f service swift] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:14.015955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:14.017162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:14.017938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:14.018496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:14.030854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:14.037903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:14.051157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1081/2198] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:18.194270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1f8e5-6701-4a2c-ae28-bd0f973ccd6b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:18.195447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1f8e5-6701-4a2c-ae28-bd0f973ccd6b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:18.196081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1f8e5-6701-4a2c-ae28-bd0f973ccd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:18.238468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1eb1f8e5-6701-4a2c-ae28-bd0f973ccd6b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:18.246260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1eb1f8e5-6701-4a2c-ae28-bd0f973ccd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:18.267751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1118/2199] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:26:18.291643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:18.296534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:18.327752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d44b-7c18-4a83-ba5f-3e5944514e47 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:18.338716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:18.341340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:18.342349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:18.343206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:18.360074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:18.361989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:18.377697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1082/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:23.520896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ded4f-3086-4658-9cea-956489826e71 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:23.521941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ded4f-3086-4658-9cea-956489826e71 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:23.522387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ded4f-3086-4658-9cea-956489826e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:23.547833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9c9ded4f-3086-4658-9cea-956489826e71 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:23.549550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9c9ded4f-3086-4658-9cea-956489826e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:23.559678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1119/2201] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 1 05:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:26:23.587627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:23.646769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6235b74-ab7c-4ad7-aa9f-008fc7445910 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:23.685031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32177743-add1-456a-b547-eb996fa187fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:23.686399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177743-add1-456a-b547-eb996fa187fe service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:23.687281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177743-add1-456a-b547-eb996fa187fe service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:23.687766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32177743-add1-456a-b547-eb996fa187fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:23.700509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32177743-add1-456a-b547-eb996fa187fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:23.702225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32177743-add1-456a-b547-eb996fa187fe service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:23.762267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1083/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:31.961556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeaeff-15be-4181-a062-22fcdedad546 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:31.962552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeaeff-15be-4181-a062-22fcdedad546 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:31.962552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeaeff-15be-4181-a062-22fcdedad546 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:31.963532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1120/2203] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:26:31.972816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69348-bcb5-4609-92c1-08e6ccbae99f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:31.973823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69348-bcb5-4609-92c1-08e6ccbae99f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:31.973823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69348-bcb5-4609-92c1-08e6ccbae99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:31.983639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=63 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:32.002739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ced69348-bcb5-4609-92c1-08e6ccbae99f None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:32.004734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ced69348-bcb5-4609-92c1-08e6ccbae99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:32.021112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1084/2204] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:26:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:26:32.040608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeaeff-15be-4181-a062-22fcdedad546 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:32.043760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-51eeaeff-15be-4181-a062-22fcdedad546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:32.054183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=41 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:32.124129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeaeff-15be-4181-a062-22fcdedad546 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:32.129116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb7134-6d1a-40f3-942a-beb763d52482 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:32.130249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7134-6d1a-40f3-942a-beb763d52482 service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.131043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7134-6d1a-40f3-942a-beb763d52482 service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.131865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7134-6d1a-40f3-942a-beb763d52482 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.151545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb7134-6d1a-40f3-942a-beb763d52482 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:32.153948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb7134-6d1a-40f3-942a-beb763d52482 service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:32.173577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1121/2205] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:32.257833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd06ec4-bba8-40b9-b296-2ba28f69c9b6 None None] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.258244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd06ec4-bba8-40b9-b296-2ba28f69c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.258566 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd06ec4-bba8-40b9-b296-2ba28f69c9b6 None None] PATH_INFO: `/` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.260050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1085/2206] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:26:32.266005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e9d8-1e6b-4032-8098-b8487a567d27 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.266410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e9d8-1e6b-4032-8098-b8487a567d27 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.266789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070e9d8-1e6b-4032-8098-b8487a567d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.289649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5070e9d8-1e6b-4032-8098-b8487a567d27 None None] MFA Rules not processed for user `98a43f7e512946aab3f1d7ef7b8d4fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:32.290907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5070e9d8-1e6b-4032-8098-b8487a567d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:32.352064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1122/2207] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:26:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:32.366161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd06ec4-bba8-40b9-b296-2ba28f69c9b6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:32.368790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dcd06ec4-bba8-40b9-b296-2ba28f69c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:32.385744 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd06ec4-bba8-40b9-b296-2ba28f69c9b6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:32.389470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a294a7-12a9-48e5-a0a8-c129b0e2b2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:32.390085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a294a7-12a9-48e5-a0a8-c129b0e2b2ea service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.390361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a294a7-12a9-48e5-a0a8-c129b0e2b2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.390631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a294a7-12a9-48e5-a0a8-c129b0e2b2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.398729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a294a7-12a9-48e5-a0a8-c129b0e2b2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:32.400213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a294a7-12a9-48e5-a0a8-c129b0e2b2ea service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:32.408828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1086/2208] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:32.531083 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15c53-8fbc-41bf-8fc8-566154e63f97 None None] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.531432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15c53-8fbc-41bf-8fc8-566154e63f97 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.531783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15c53-8fbc-41bf-8fc8-566154e63f97 None None] PATH_INFO: `/` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.533871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1123/2209] 10.222.0.57 () {54 vars in 921 bytes} [Thu Sep 1 05:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:26:32.540386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc08bb9-9796-4808-b070-304f76aab241 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.540700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc08bb9-9796-4808-b070-304f76aab241 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.540957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc08bb9-9796-4808-b070-304f76aab241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.573913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5fc08bb9-9796-4808-b070-304f76aab241 None None] MFA Rules not processed for user `a467a7344fff4987967c8655dc2965a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:32.576052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5fc08bb9-9796-4808-b070-304f76aab241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:32.593649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1087/2210] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Sep 1 05:26:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:32.608008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15c53-8fbc-41bf-8fc8-566154e63f97 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:32.623669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15c53-8fbc-41bf-8fc8-566154e63f97 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:32.628745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:32.629507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:32.629851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:32.630185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:32.644643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:32.646258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:32.659573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1124/2211] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:26:38.874662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:38.875381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:38.875381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:38.897923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:26:38.899173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:26:38.907614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1088/2212] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:26:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:26:38.926632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:26:38.946522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd000470-9bf4-4341-9099-e54d16ec2daa service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:26:38.955527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:26:38.956514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:26:38.957039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:26:38.957494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:26:38.972217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:26:38.974574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:26:38.985769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1125/2213] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:26:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:26:48.891500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=14 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:48.981105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=60 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:01.792538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:01.795365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:01.822734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d5651-f8f9-4a71-8b38-3cd7c57da07d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:01.830972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:01.832007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:01.832719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:01.833197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] PATH_INFO: `/v3/users/ae2819090d7b49dd931c705251e9fc49` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:01.835242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2819090d7b49dd931c705251e9fc49)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:01.837448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:01.902844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2819090d7b49dd931c705251e9fc49'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:01.915631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2819090d7b49dd931c705251e9fc49'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:01.916913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2819090d7b49dd931c705251e9fc49'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:01.944263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2819090d7b49dd931c705251e9fc49'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:01.953903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dc886e39-719c-4297-ac81-df48746cd596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2819090d7b49dd931c705251e9fc49'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:01.963865 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1089/2214] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:27:01 2022] DELETE /identity/v3/users/ae2819090d7b49dd931c705251e9fc49 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:27:02.179695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.192228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3167b8-7af2-436d-ab60-91f8d7617177 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.268582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.269267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.269546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.269933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] PATH_INFO: `/v3/projects/99994abe90d9440899ed4a7bf00d6bda` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.271148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=99994abe90d9440899ed4a7bf00d6bda)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.273128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.323749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99994abe90d9440899ed4a7bf00d6bda', 'request_id': 'req-0ee1bbda-44a7-477a-b866-47bc9f20f54e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:02.330281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99994abe90d9440899ed4a7bf00d6bda', 'request_id': 'req-0ee1bbda-44a7-477a-b866-47bc9f20f54e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:02.339880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99994abe90d9440899ed4a7bf00d6bda', 'request_id': 'req-0ee1bbda-44a7-477a-b866-47bc9f20f54e'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:02.351480 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] The token cache is being invalidate because project 99994abe90d9440899ed4a7bf00d6bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:27:02.351769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:02.352443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-0ee1bbda-44a7-477a-b866-47bc9f20f54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:27:02.354026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1126/2215] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:27:02 2022] DELETE /identity/v3/projects/99994abe90d9440899ed4a7bf00d6bda => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:27:02.360492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.360793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.361064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.383340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:02.384558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:02.471158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1090/2216] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:27:02.481205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.481617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.481984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.508653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:02.510812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:02.522943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1127/2217] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:02.529826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.550746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df452d11-d698-4a99-b864-1c4244f7a1af None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.560345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.561560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.562113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.562663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.563955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:27:02.564545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.567945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.587642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1091/2218] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:27:02.592349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.615082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ac68-344d-423b-8a0e-ebc613aeaec6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.619613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.620301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.620764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.621091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.622871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.625227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.684759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1128/2219] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:27:02 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:27:02.686923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.705534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e39f-7e29-468d-9fb3-65ed8858185d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.798789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.799905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.800286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.800784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.801662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.805220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.816674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:02.837716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1092/2220] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:27:02 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:27:02.843594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.855549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba8ae-6f13-49f9-9070-c22794e14d83 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.860771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.861550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.861828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.862098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.862770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.864526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.877132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1129/2221] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:27:02.881878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.900345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765a295-b706-4c62-89b1-d74b3ddf3b95 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.907100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2eca-f42a-4bee-88fc-363beab93b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.907853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2eca-f42a-4bee-88fc-363beab93b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.908224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2eca-f42a-4bee-88fc-363beab93b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.908554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2eca-f42a-4bee-88fc-363beab93b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.909318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2eca-f42a-4bee-88fc-363beab93b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.911289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2eca-f42a-4bee-88fc-363beab93b65 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.929778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1093/2222] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:27:02.934520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:02.946029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131c7b-7165-44c1-93fd-f0145bf519b9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:02.951572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:02.952275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.952537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.952879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] PATH_INFO: `/v3/projects/aa9b1ca8d4104ba88294e4410f13ac1f/users/f8dc78d4023c445cb31787a601f912d5/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:02.971108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9b1ca8d4104ba88294e4410f13ac1f, user_id=f8dc78d4023c445cb31787a601f912d5, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:02.974440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:02.991912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1130/2223] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:27:02 2022] PUT /identity/v3/projects/aa9b1ca8d4104ba88294e4410f13ac1f/users/f8dc78d4023c445cb31787a601f912d5/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:27:02.997757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443467dd-b3c6-4af7-b8bd-f876a6958927 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:02.998073 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443467dd-b3c6-4af7-b8bd-f876a6958927 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:02.998525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443467dd-b3c6-4af7-b8bd-f876a6958927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:03.020290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-443467dd-b3c6-4af7-b8bd-f876a6958927 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:03.021666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-443467dd-b3c6-4af7-b8bd-f876a6958927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:03.093276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1094/2224] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:03.103321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:03.105399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:03.143759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:03.180370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb46cd-44c9-487b-b2f1-cb347d6cbde3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:03.184655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:03.185305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:03.185580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:03.185843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:03.196534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:03.197934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:03.210512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1131/2225] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:27:05.117599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37412ea-f336-47d8-9cb3-8e8b22aea8cf None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:05.119167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37412ea-f336-47d8-9cb3-8e8b22aea8cf None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:05.119890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37412ea-f336-47d8-9cb3-8e8b22aea8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:05.163429 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-b37412ea-f336-47d8-9cb3-8e8b22aea8cf None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:05.165650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b37412ea-f336-47d8-9cb3-8e8b22aea8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:05.291824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1095/2226] 10.222.0.57 () {58 vars in 967 bytes} [Thu Sep 1 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:05.314471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:05.316553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:05.459159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea9f6d-4231-4318-bec6-041ffeebeb1b service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:05.465972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:05.466759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:05.467041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:05.467577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:05.478432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:05.480129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:05.492486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1132/2227] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:27:08.818594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:08.823041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:08.823041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:08.884501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] MFA Rules not processed for user `f8dc78d4023c445cb31787a601f912d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:08.885783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:08.999239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1096/2228] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:09.005685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:09.028859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b2aa6-9c54-4fa1-815d-55d272a995cd service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:09.040233 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:09.041392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:09.041935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:09.042466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:09.044023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:09.047474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:09.095080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1133/2229] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:27:09 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:27:09.099819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:09.111667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22179be2-dad0-4708-9825-c72f16872a53 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:09.130089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:09.205091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:09.206188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:09.206613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:09.207278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:09.208424 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:09.211498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:09.241168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1097/2230] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:27:09 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:27:09.246151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:09.258797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913123-aad3-4a79-aea2-5bb55ed9d822 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:09.264463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:09.265152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:09.265427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:09.265702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:09.266366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:09.268028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:09.282529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1134/2231] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:27:09.289701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:09.302738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6339-d87d-44f8-beb0-5b45de16db6a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:09.311421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:09.312547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:09.312978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:09.313369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] PATH_INFO: `/v3/projects/c64e37506ae74aae9a4692e4dbd3e4d9/users/a2edcf64273f456b8086961ec9b7781b/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:09.340370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64e37506ae74aae9a4692e4dbd3e4d9, user_id=a2edcf64273f456b8086961ec9b7781b, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:09.346413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:09.373090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1098/2232] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:27:09 2022] PUT /identity/v3/projects/c64e37506ae74aae9a4692e4dbd3e4d9/users/a2edcf64273f456b8086961ec9b7781b/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:27:09.377579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:09.388936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0ff2-391c-4529-a206-9172ae034d68 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:09.503732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a8a6-9ade-45d7-a52b-505f1c335fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:09.505503 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a8a6-9ade-45d7-a52b-505f1c335fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:09.507219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a8a6-9ade-45d7-a52b-505f1c335fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:09.507688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a8a6-9ade-45d7-a52b-505f1c335fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:09.508455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a8a6-9ade-45d7-a52b-505f1c335fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:09.510366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a8a6-9ade-45d7-a52b-505f1c335fe0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:09.523803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1135/2233] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:27:09.528198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:09.542099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137a51c-43f0-41b2-87a7-8cc96cf20fd2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:09.548589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:09.549867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:09.550413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:09.550929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] PATH_INFO: `/v3/projects/c64e37506ae74aae9a4692e4dbd3e4d9/users/a2edcf64273f456b8086961ec9b7781b/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:09.554693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64e37506ae74aae9a4692e4dbd3e4d9, user_id=a2edcf64273f456b8086961ec9b7781b, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:09.560149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:09.588687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1099/2234] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:27:09 2022] PUT /identity/v3/projects/c64e37506ae74aae9a4692e4dbd3e4d9/users/a2edcf64273f456b8086961ec9b7781b/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:27:16.568815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994ae2-1445-4158-b451-257b20ff9424 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:16.570305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994ae2-1445-4158-b451-257b20ff9424 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:16.570971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994ae2-1445-4158-b451-257b20ff9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:16.631168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bb994ae2-1445-4158-b451-257b20ff9424 None None] MFA Rules not processed for user `a2edcf64273f456b8086961ec9b7781b`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:16.634485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bb994ae2-1445-4158-b451-257b20ff9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:16.653097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:16.768862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1136/2235] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:27:16.790170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:16.794549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:16.907254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada482c-81e3-4926-aa96-b69ea1aecc04 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:16.912660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:16.913310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:16.913597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:16.913869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:16.994034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:16.995513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:17.007020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1100/2236] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:27:17.182000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259dc55-5a3a-40a2-bb91-b53f90bfe5e2 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:17.182333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259dc55-5a3a-40a2-bb91-b53f90bfe5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:17.182568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259dc55-5a3a-40a2-bb91-b53f90bfe5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:17.207677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8259dc55-5a3a-40a2-bb91-b53f90bfe5e2 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:17.209009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8259dc55-5a3a-40a2-bb91-b53f90bfe5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:17.295858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1137/2237] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:27:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:17.324828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:17.348687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:17.411016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38f3dc-6bed-4959-94c8-bd72b68a7ad7 service glance] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:17.416404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f35be-4c61-4eb2-aaa1-f06fb8d2cdf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:17.417059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f35be-4c61-4eb2-aaa1-f06fb8d2cdf0 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:17.417341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f35be-4c61-4eb2-aaa1-f06fb8d2cdf0 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:17.417615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f35be-4c61-4eb2-aaa1-f06fb8d2cdf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:17.427527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f35be-4c61-4eb2-aaa1-f06fb8d2cdf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:17.429969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f35be-4c61-4eb2-aaa1-f06fb8d2cdf0 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:17.439969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1101/2238] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:27.288784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=49 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:27.400252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:27.400750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:27.401349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:27.429812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] MFA Rules not processed for user `c53e53ea051c4594b6c84f4ae58ac43f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:27.431116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:27.436547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=23 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:27.584033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1138/2239] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:28.446913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1015c-ff50-414f-9af3-2be7ab4437bd None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:28.447591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1015c-ff50-414f-9af3-2be7ab4437bd None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:28.447591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1015c-ff50-414f-9af3-2be7ab4437bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:28.468945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4fc1015c-ff50-414f-9af3-2be7ab4437bd None None] MFA Rules not processed for user `f8dc78d4023c445cb31787a601f912d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:28.470250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4fc1015c-ff50-414f-9af3-2be7ab4437bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:28.478206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1102/2240] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:27:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:27:32.548805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:32.552394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:32.682963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f93c-5e6a-4e39-a806-753d871da964 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:32.688848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:32.689488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:32.689741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:32.690049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:32.692147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:32.781619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:32.783295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:32.797953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1139/2241] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:27:33.744451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:33.745531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:33.745950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:33.770774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:27:33.772036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:33.782153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1103/2242] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:27:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:27:33.796865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:33.814222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f8b1-9205-437f-8b54-c5f33122319c service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:33.822515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:33.823302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:33.823680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:33.824053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:33.834198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:33.835931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:33.870242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1140/2243] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:27:39.595472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:39.597075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:39.670319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5be02-d818-47ce-8741-b389029ddb19 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:39.676250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:39.677731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:39.678675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:39.679312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:39.687811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:39.726132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:39.729354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:39.753169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1104/2244] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:27:42.559601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:42.571007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a905f-9f81-456c-9e71-24a98e5376e4 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:42.575028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:42.575672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:42.575951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:42.576221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:42.578242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:42.593924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:42.595962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:42.610537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1141/2245] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:27:49.743712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=32 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:52.565349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:52.576216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed149e5-9558-4e9b-b96c-98a1d8994d79 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:52.581427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:52.582151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:52.582498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:52.582945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:52.585235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:52.595051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:52.599383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:52.603691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:52.609637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fb250-de83-43e8-ad4a-d9ff96d17704 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:52.617016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:52.617991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:52.618426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:52.618841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:52.620308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1105/2246] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:27:52.630174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:52.632993 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:52.648882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1142/2247] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:27:57.076537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:27:57.091966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfe15-c449-4561-afc7-dfda1fe6e751 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:27:57.099173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:27:57.099790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:27:57.100066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:27:57.100339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:27:57.102259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:27:57.173591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:27:57.175765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:27:57.187654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1106/2248] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:27:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:02.641227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:07.182052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=34 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:10.338403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:10.340735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:10.380346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3adb6-2d7b-414e-95b8-b81a1fd1ff61 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:10.411392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:10.412757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:10.413402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:10.413932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:10.417996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:10.477741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:10.484591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:10.510936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1143/2249] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:10.878824 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:10.889091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d736-df2f-433b-81ba-620218221b96 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:10.895455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c50404-ab5d-4af1-b235-f9cd6d68e65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:10.896225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50404-ab5d-4af1-b235-f9cd6d68e65f service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:10.896521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50404-ab5d-4af1-b235-f9cd6d68e65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:10.896825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c50404-ab5d-4af1-b235-f9cd6d68e65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:10.910716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c50404-ab5d-4af1-b235-f9cd6d68e65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:10.912729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c50404-ab5d-4af1-b235-f9cd6d68e65f service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:10.932878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1107/2250] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:15.299716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:15.314124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92cc7d-a2b5-48d5-b9b5-8eb15f363770 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:15.324194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:15.325329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:15.325803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:15.326307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:15.329567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:15.432672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:15.434680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:15.451175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1144/2251] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:15.850606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:15.851084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:15.851452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:15.897123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] MFA Rules not processed for user `8c8ad3919d764781a90420e48c65df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:28:15.898379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:15.905711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1108/2252] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:28:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:28:16.132514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:16.153709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092f5e-1b31-4475-936d-938bef6e5269 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:16.166915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:16.168838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:16.169530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:16.169995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:16.174778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:16.223921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:16.226684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:16.242282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1145/2253] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:16.410225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:16.430394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553e9e-1bc6-4885-b1c2-ee3b145e232b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:16.437096 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:16.438873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:16.439800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:16.439994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:16.443787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:16.466538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:16.469662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17819b-1c61-4393-a3d1-7fe181a70497 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:16.492972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1109/2254] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:17.091904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:17.095321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:17.272560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014b4b6-36f7-4f3c-a981-44b6b1b7e50e service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:17.278436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:17.279174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:17.279513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:17.279841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:17.281975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:17.294493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:17.296325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:17.307712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1146/2255] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:26.478668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=15 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:27.302884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=72 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:27.346384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:27.346827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:27.347188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:27.370540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] MFA Rules not processed for user `de343953c3f24a4fbf8277edb098f165`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:28:27.372094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:27.381475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1110/2256] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:28:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:28:27.787473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:27.799165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122595e2-cad2-4421-931a-7ab956cd252d service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:27.804806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:27.805645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:27.806142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:27.806642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:27.809135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:27.823568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:27.826052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:27.838269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1147/2257] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:30.807367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:30.899692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be269-5dd5-4183-88a3-4b941e733612 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:30.915898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:30.916980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:30.917519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:30.919279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:30.922991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:30.997431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:30.999053 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:31.011815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1111/2258] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:28:37.834045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:39.792462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:28:39.794379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:39.926777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c8314-886f-4011-85bf-99386068d0c4 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:28:39.932527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:28:39.933254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:28:39.933696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:28:39.934170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:28:39.938663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:28:39.957252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:28:39.959813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8395c-f83d-4bb9-a7b4-ccfc4af6bb68 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:28:39.976644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1148/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:28:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:28:41.006310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=31 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:49.968288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=48 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:03.813491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:03.838220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1086-c60a-4d1a-9ac7-84fe34ec8b85 service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:03.842887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:03.843615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:03.844149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:03.844571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:03.846851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:03.982178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:03.984219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:04.025764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1112/2260] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:07.534835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:07.535416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:07.535416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:07.557559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] MFA Rules not processed for user `3d27e93db5ec41e29196e6ff64608b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:07.560872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:07.573133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1149/2261] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:29:08.653204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:08.655078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:08.679179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcf011-a033-40b9-aa4f-174e5557b53a service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:08.687618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:08.688873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:08.689437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:08.689992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] PATH_INFO: `/v3/users/c53e53ea051c4594b6c84f4ae58ac43f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:08.692216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53e53ea051c4594b6c84f4ae58ac43f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:08.710311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:08.807516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53e53ea051c4594b6c84f4ae58ac43f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:08.821315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53e53ea051c4594b6c84f4ae58ac43f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:08.822246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53e53ea051c4594b6c84f4ae58ac43f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:08.840649 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53e53ea051c4594b6c84f4ae58ac43f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:08.849817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-0b39e61c-810c-4457-8a81-27f26989717e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53e53ea051c4594b6c84f4ae58ac43f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:08.859516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1113/2262] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:08 2022] DELETE /identity/v3/users/c53e53ea051c4594b6c84f4ae58ac43f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:09.075805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.090704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313087a-99bf-4c68-a5a3-276149c9f338 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.161054 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.161866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.162240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.162633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] PATH_INFO: `/v3/projects/1447b14ed43f44508789a67b5d1f7b5f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.164028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1447b14ed43f44508789a67b5d1f7b5f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.166191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.227839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1447b14ed43f44508789a67b5d1f7b5f', 'request_id': 'req-c33040a7-91fd-4096-96e6-3d4dfaec47ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:09.235351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1447b14ed43f44508789a67b5d1f7b5f', 'request_id': 'req-c33040a7-91fd-4096-96e6-3d4dfaec47ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:09.244931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1447b14ed43f44508789a67b5d1f7b5f', 'request_id': 'req-c33040a7-91fd-4096-96e6-3d4dfaec47ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:09.257866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] The token cache is being invalidate because project 1447b14ed43f44508789a67b5d1f7b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:09.258150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:09.258833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c33040a7-91fd-4096-96e6-3d4dfaec47ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:09.260521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1150/2263] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:09 2022] DELETE /identity/v3/projects/1447b14ed43f44508789a67b5d1f7b5f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:09.266458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.266743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.267041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.312751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:09.347448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:09.349766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:09.443725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1114/2264] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:09.452386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.452703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.453219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.479382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:09.480526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:09.490787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1151/2265] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:09.495856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.512993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343aa90-c3f9-4177-8717-ef5e0f82f8ef None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.518859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.519795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.520230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.520738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.521571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:09.521881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.524138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.545541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1115/2266] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:29:09.550809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.570309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85f0c3-b975-412a-82c5-1fbaae655598 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.579755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.580812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.581972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.582452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.583359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.585794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.637166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1152/2267] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:09 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:09.638614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.650578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4566d74-7ff0-49d9-8e00-d31e65bfa16e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.730323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.730986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.731184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.731452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.732377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.734368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.761162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1116/2268] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:09 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:09.766303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.777822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab57c9-73b1-498d-89be-4746486e7b02 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.783043 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.783687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.783962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.784232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.785018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.788736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.810005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1153/2269] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:09.814470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.825822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8c32-e678-4548-9f46-fbbc69e4ee7c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.830920 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899d88-a370-48e3-9e71-0c55763e9738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.831556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899d88-a370-48e3-9e71-0c55763e9738 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.831873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899d88-a370-48e3-9e71-0c55763e9738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.833158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899d88-a370-48e3-9e71-0c55763e9738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.833158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8899d88-a370-48e3-9e71-0c55763e9738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.834579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8899d88-a370-48e3-9e71-0c55763e9738 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.851794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1117/2270] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:09.853621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:09.866426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e2a4-fa7b-4367-a471-8bbb6dde3cea admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:09.873727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:09.874518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.874849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.875186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] PATH_INFO: `/v3/projects/8c11b9f72b7e4e3aa7dd1ed600b7d3c6/users/7548ced8e08f4c36b2a5cf51bd71e4d8/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.901007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c11b9f72b7e4e3aa7dd1ed600b7d3c6, user_id=7548ced8e08f4c36b2a5cf51bd71e4d8, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:09.904810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:09.929096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1154/2271] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:09 2022] PUT /identity/v3/projects/8c11b9f72b7e4e3aa7dd1ed600b7d3c6/users/7548ced8e08f4c36b2a5cf51bd71e4d8/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:09.939832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:09.940526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:09.940923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:09.974483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] MFA Rules not processed for user `7548ced8e08f4c36b2a5cf51bd71e4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:09.975692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:10.037493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:10.051970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1118/2272] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:10.064781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:10.067121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:10.088996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:10.152766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bfbfc-d9bc-4805-bdea-4abd54582278 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:10.160191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb3a42-8be7-43c3-af25-0dfd93afe8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:10.161013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3a42-8be7-43c3-af25-0dfd93afe8cd service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:10.161287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3a42-8be7-43c3-af25-0dfd93afe8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:10.161553 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3a42-8be7-43c3-af25-0dfd93afe8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:10.172885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3a42-8be7-43c3-af25-0dfd93afe8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:10.174442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3a42-8be7-43c3-af25-0dfd93afe8cd service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:10.189337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1155/2273] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:19.246025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:19.323599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a24d8d-4554-40e6-9cae-7eaacba02ade None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:19.330223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:19.330983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:19.331146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:19.331622 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] PATH_INFO: `/v3/users/7548ced8e08f4c36b2a5cf51bd71e4d8` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:19.332853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7548ced8e08f4c36b2a5cf51bd71e4d8)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:19.335000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:19.408395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7548ced8e08f4c36b2a5cf51bd71e4d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:19.421375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7548ced8e08f4c36b2a5cf51bd71e4d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:19.422441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7548ced8e08f4c36b2a5cf51bd71e4d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:19.448182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7548ced8e08f4c36b2a5cf51bd71e4d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:19.459232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7548ced8e08f4c36b2a5cf51bd71e4d8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:19.467428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1119/2274] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:19 2022] DELETE /identity/v3/users/7548ced8e08f4c36b2a5cf51bd71e4d8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:19.472151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:19.472744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:19.473598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:19.497735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:19.499493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:19.592099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1156/2275] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:19.603395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:19.605271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:19.732368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362e257-7666-4d75-84ca-ae2b3e53e0be admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:19.744123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7240df4-3575-4438-9f24-78573ad286c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:19.744436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240df4-3575-4438-9f24-78573ad286c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:19.744826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240df4-3575-4438-9f24-78573ad286c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:19.745144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240df4-3575-4438-9f24-78573ad286c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:19.759430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7240df4-3575-4438-9f24-78573ad286c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:19.762990 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7240df4-3575-4438-9f24-78573ad286c4 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:19.784134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1120/2276] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:20.224105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.226155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:20.246723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73bff-b4c2-42d5-9a42-4e61bc980fa1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.255380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.256478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.257044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.257532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] PATH_INFO: `/v3/projects/8c11b9f72b7e4e3aa7dd1ed600b7d3c6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.260464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c11b9f72b7e4e3aa7dd1ed600b7d3c6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.264130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.333799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c11b9f72b7e4e3aa7dd1ed600b7d3c6', 'request_id': 'req-80c47a8e-01c2-4b42-b3ec-5c535770aefd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:20.343473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c11b9f72b7e4e3aa7dd1ed600b7d3c6', 'request_id': 'req-80c47a8e-01c2-4b42-b3ec-5c535770aefd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:20.355471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c11b9f72b7e4e3aa7dd1ed600b7d3c6', 'request_id': 'req-80c47a8e-01c2-4b42-b3ec-5c535770aefd'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:20.372548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] The token cache is being invalidate because project 8c11b9f72b7e4e3aa7dd1ed600b7d3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:20.372860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:20.373656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-80c47a8e-01c2-4b42-b3ec-5c535770aefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:20.375495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1157/2277] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:20 2022] DELETE /identity/v3/projects/8c11b9f72b7e4e3aa7dd1ed600b7d3c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:20.382332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.383284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.383284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.397686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:20.422236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:20.424051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:20.526705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1121/2278] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:20.535686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.536299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.536299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.559284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:20.560711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:20.570388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1158/2279] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:20.575272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.585800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4bf71-5acd-4ecc-a185-122235698f60 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.591558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.592444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.592861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.593343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.594144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:20.594544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.596345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.611443 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1122/2280] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:29:20.616823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.627514 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560110a4-5c30-4e70-9240-44c7c49f1964 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.632676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.633377 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.633690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.633997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.634700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.637084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.672256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1159/2281] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:20 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:20.677077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.689273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b0f06-0162-49d7-96a2-6c9e44f2fd09 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.762451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.763301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.763769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.764108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.765236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.767729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.794172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1123/2282] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:20 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:20.799583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.818907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab021-55e4-4f58-816c-b2d60f87e20b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.825205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.826175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.826465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.826722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.827386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.829108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.832144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:20.846328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1160/2283] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:20.851893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.864264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4850e-c8b6-499c-b06d-3de6671a246a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.870397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9deca-7ef7-4e54-b9af-80117adaf04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.871082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9deca-7ef7-4e54-b9af-80117adaf04d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.871406 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9deca-7ef7-4e54-b9af-80117adaf04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.871725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9deca-7ef7-4e54-b9af-80117adaf04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.872503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9deca-7ef7-4e54-b9af-80117adaf04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.874336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9deca-7ef7-4e54-b9af-80117adaf04d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.888273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1124/2284] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:20.892959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:20.904731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b09f1-e67c-4d0e-8d7a-e112eedd820a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:20.910741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:20.911428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.911698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.911960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] PATH_INFO: `/v3/projects/438783a0c5fb452081280f3509065a46/users/7e57dd1bff044c93a6e54906a1cd5137/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:20.935096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438783a0c5fb452081280f3509065a46, user_id=7e57dd1bff044c93a6e54906a1cd5137, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:20.938956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:20.958957 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1161/2285] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:20 2022] PUT /identity/v3/projects/438783a0c5fb452081280f3509065a46/users/7e57dd1bff044c93a6e54906a1cd5137/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:20.976953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0833-e047-4416-9791-980e3315807d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:20.977613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0833-e047-4416-9791-980e3315807d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:20.978081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0833-e047-4416-9791-980e3315807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:21.025079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c77e0833-e047-4416-9791-980e3315807d None None] MFA Rules not processed for user `7e57dd1bff044c93a6e54906a1cd5137`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:21.027282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c77e0833-e047-4416-9791-980e3315807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:21.141805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:21.151118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1125/2286] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:21.161024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:21.162905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:21.268455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f9f03-e03a-4dd2-833c-eced9fa167e9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:21.275636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4957d-417d-424a-abfd-8bc908f4d17a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:21.276282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4957d-417d-424a-abfd-8bc908f4d17a service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:21.276558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4957d-417d-424a-abfd-8bc908f4d17a service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:21.276864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4957d-417d-424a-abfd-8bc908f4d17a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:21.287420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4957d-417d-424a-abfd-8bc908f4d17a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:21.289100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4957d-417d-424a-abfd-8bc908f4d17a service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:21.301547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1162/2287] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:21.593427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e0833-e047-4416-9791-980e3315807d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:21.671023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e0833-e047-4416-9791-980e3315807d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:21.676711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:21.677393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:21.677671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:21.677942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] PATH_INFO: `/v3/users/7e57dd1bff044c93a6e54906a1cd5137` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:21.679298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e57dd1bff044c93a6e54906a1cd5137)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:21.681337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:21.749229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e57dd1bff044c93a6e54906a1cd5137'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:21.759531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e57dd1bff044c93a6e54906a1cd5137'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:21.760265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e57dd1bff044c93a6e54906a1cd5137'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:21.779955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e57dd1bff044c93a6e54906a1cd5137'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:21.793472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e57dd1bff044c93a6e54906a1cd5137'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:21.805817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1126/2288] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:21 2022] DELETE /identity/v3/users/7e57dd1bff044c93a6e54906a1cd5137 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:21.810938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:21.811572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:21.811572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:21.834889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:21.836413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:21.945052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1163/2289] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:21.958134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:21.959864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:22.057540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724727ca-a76d-495b-a0e5-a9711fc086ab admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:22.063652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d606ea-8e01-4862-982f-820803d6412d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:22.064378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d606ea-8e01-4862-982f-820803d6412d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:22.064778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d606ea-8e01-4862-982f-820803d6412d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:22.065098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d606ea-8e01-4862-982f-820803d6412d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:22.077503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d606ea-8e01-4862-982f-820803d6412d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:22.079033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d606ea-8e01-4862-982f-820803d6412d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:22.090764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1127/2290] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:29:22.484202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:22.486983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:22.504579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782f03-a2df-45bb-8e34-6b8eb49bf10e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:22.520805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:22.521783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:22.522066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:22.522211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] PATH_INFO: `/v3/projects/438783a0c5fb452081280f3509065a46` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:22.523742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=438783a0c5fb452081280f3509065a46)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:22.525805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:22.595858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438783a0c5fb452081280f3509065a46', 'request_id': 'req-db570e92-8e16-45b4-a7e9-d8053e33d91b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:22.603328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438783a0c5fb452081280f3509065a46', 'request_id': 'req-db570e92-8e16-45b4-a7e9-d8053e33d91b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:22.605458 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:22.615657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438783a0c5fb452081280f3509065a46', 'request_id': 'req-db570e92-8e16-45b4-a7e9-d8053e33d91b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:22.631227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] The token cache is being invalidate because project 438783a0c5fb452081280f3509065a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:22.631772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:22.632820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-db570e92-8e16-45b4-a7e9-d8053e33d91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:22.635351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1164/2291] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:22 2022] DELETE /identity/v3/projects/438783a0c5fb452081280f3509065a46 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:22.643186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:22.643942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:22.643942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:22.672271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:22.673704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:22.694589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:22.755161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1128/2292] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:22.765427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:22.765822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:22.766366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:22.791384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:22.792678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:22.803488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1165/2293] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:29:22.808341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:22.820955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae53cb-3974-4b55-871c-cd705be9082c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:22.828494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:22.829145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:22.829427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:22.829704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:22.830374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:22.830680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:22.832318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:22.851965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1129/2294] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:29:22.853659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:22.864448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c05fe-9f3d-4634-a7c8-7ea98d8bbfbf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:22.869629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:22.870391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:22.870731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:22.871075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:22.871877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:22.874198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:22.916842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1166/2295] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:22 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:29:22.919116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:22.935603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2500fc-7d2f-4cda-a035-275425909288 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.023247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.023931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.024220 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.024486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.025257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.027455 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.053735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1130/2296] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:22 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:23.059067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.074606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13622666-67ec-4a1e-9725-40bbd02ba6b1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.083830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.084909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.085361 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.085749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.086723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.089392 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.115922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1167/2297] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:23.119246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.131642 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859bc8-3fa3-4524-8612-f0907ddab6cd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.137367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2eb1f4-487b-4c32-a84b-e8e70c16bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.138296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb1f4-487b-4c32-a84b-e8e70c16bf62 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.138577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb1f4-487b-4c32-a84b-e8e70c16bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.138851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2eb1f4-487b-4c32-a84b-e8e70c16bf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.139528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2eb1f4-487b-4c32-a84b-e8e70c16bf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.141267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2eb1f4-487b-4c32-a84b-e8e70c16bf62 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.156211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1131/2298] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:23.161754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.174907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760606c-f793-48f3-b09c-fa890412d64d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.180262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.180995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.181478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.182225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] PATH_INFO: `/v3/projects/462037dda5314e4497175e20110d2466/users/adb2689e22e84652aff94c73b843df30/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.206894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462037dda5314e4497175e20110d2466, user_id=adb2689e22e84652aff94c73b843df30, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.210702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.229745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1168/2299] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:23 2022] PUT /identity/v3/projects/462037dda5314e4497175e20110d2466/users/adb2689e22e84652aff94c73b843df30/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:23.251666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60112009-3af2-41b8-bf26-be132618607f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.251968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60112009-3af2-41b8-bf26-be132618607f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.252383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60112009-3af2-41b8-bf26-be132618607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.291605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-60112009-3af2-41b8-bf26-be132618607f None None] MFA Rules not processed for user `adb2689e22e84652aff94c73b843df30`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:23.292933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-60112009-3af2-41b8-bf26-be132618607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:23.383950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1132/2300] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:23.390304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.477429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa251b-01be-4726-a8da-638781ea5927 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.482646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.483297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.483560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.483821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.484469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.486473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.523178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1169/2301] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:23 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:23.529217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60112009-3af2-41b8-bf26-be132618607f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.541479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60112009-3af2-41b8-bf26-be132618607f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.561638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:23.641123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.641772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.642489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.642489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.643051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.645116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.678945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1133/2302] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:23 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:23.685487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.706676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1da3db-28af-46bc-bde6-9b2298ba7bd3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.714186 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.714945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.715326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.715844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.716637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.718512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.733870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1170/2303] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:23.739303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.759654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb3c5d-b69e-4e44-a215-943e665e50b6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.769571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.770806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.771302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.771795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] PATH_INFO: `/v3/projects/7dc543e4a54e46c9a79ffe12699feb16/users/1a026a4b600044b68b6ecf86226bb264/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.795243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc543e4a54e46c9a79ffe12699feb16, user_id=1a026a4b600044b68b6ecf86226bb264, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.800869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.828897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1134/2304] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:23 2022] PUT /identity/v3/projects/7dc543e4a54e46c9a79ffe12699feb16/users/1a026a4b600044b68b6ecf86226bb264/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:23.836121 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:23.857150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16cb8f-4d7f-44e7-9c96-6d746abf51da admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:23.946041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:23.956434 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07194fe3-7004-4138-952f-0d5b814e176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:23.957387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07194fe3-7004-4138-952f-0d5b814e176b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:23.958005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07194fe3-7004-4138-952f-0d5b814e176b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:23.960010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07194fe3-7004-4138-952f-0d5b814e176b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:23.961605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07194fe3-7004-4138-952f-0d5b814e176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:23.963350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07194fe3-7004-4138-952f-0d5b814e176b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:23.983737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1171/2305] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:23.990393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:24.002120 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fd77-6680-4ae1-b041-445852daa094 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:24.008122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:24.009175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:24.009614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:24.010080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] PATH_INFO: `/v3/projects/7dc543e4a54e46c9a79ffe12699feb16/users/1a026a4b600044b68b6ecf86226bb264/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:24.012830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc543e4a54e46c9a79ffe12699feb16, user_id=1a026a4b600044b68b6ecf86226bb264, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:24.016322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:24.033001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1135/2306] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:23 2022] PUT /identity/v3/projects/7dc543e4a54e46c9a79ffe12699feb16/users/1a026a4b600044b68b6ecf86226bb264/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:24.052354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:24.052881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:24.053378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:24.099504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] MFA Rules not processed for user `1a026a4b600044b68b6ecf86226bb264`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:24.101007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:24.224818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1172/2307] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:24.245359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:24.247862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:24.350691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53559ac5-f7ae-4398-83fa-13b2e0361e41 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:24.357847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f388c-3606-44ce-9621-5d3f52ea4dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:24.359515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f388c-3606-44ce-9621-5d3f52ea4dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:24.360009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f388c-3606-44ce-9621-5d3f52ea4dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:24.360486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f388c-3606-44ce-9621-5d3f52ea4dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:24.378346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f388c-3606-44ce-9621-5d3f52ea4dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:24.381176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f388c-3606-44ce-9621-5d3f52ea4dc9 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:24.401211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1136/2308] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:25.057588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:25.151157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9595092-79c1-428c-b3a3-4fcd6a689e8f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:25.159769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:25.160831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:25.161283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:25.161724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] PATH_INFO: `/v3/users/adb2689e22e84652aff94c73b843df30` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:25.163859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb2689e22e84652aff94c73b843df30)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:25.167791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:25.246432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb2689e22e84652aff94c73b843df30'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:25.247273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb2689e22e84652aff94c73b843df30'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:25.259541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb2689e22e84652aff94c73b843df30'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:25.276653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb2689e22e84652aff94c73b843df30'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:25.282968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:25.288048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb2689e22e84652aff94c73b843df30'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:25.298700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1173/2309] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:25 2022] DELETE /identity/v3/users/adb2689e22e84652aff94c73b843df30 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:25.305596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:25.306326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:25.306813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:25.340679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:25.342820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:25.438770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1137/2310] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:25.450933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:25.452708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:25.525859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b64d3-b939-4d29-a155-4968eca99d80 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:25.530460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:25.531203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:25.531578 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:25.531912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:25.543395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:25.545089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:25.557293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1174/2311] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:25.913736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:25.915396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:25.933815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af282a5c-193b-4bd1-a1d0-fe7fb2fac457 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:25.941987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:25.943080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:25.943571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:25.944057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] PATH_INFO: `/v3/projects/462037dda5314e4497175e20110d2466` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:25.946305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] RBAC: Authorizing `identity:delete_project(project_id=462037dda5314e4497175e20110d2466)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:25.949863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:25.962914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:26.016710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462037dda5314e4497175e20110d2466', 'request_id': 'req-d91beeb7-f1ac-4777-901d-492913d0236a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.024498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462037dda5314e4497175e20110d2466', 'request_id': 'req-d91beeb7-f1ac-4777-901d-492913d0236a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.032681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462037dda5314e4497175e20110d2466', 'request_id': 'req-d91beeb7-f1ac-4777-901d-492913d0236a'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.050340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] The token cache is being invalidate because project 462037dda5314e4497175e20110d2466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:26.050668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.051360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.053051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1138/2312] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:25 2022] DELETE /identity/v3/projects/462037dda5314e4497175e20110d2466 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:26.057738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:26.068794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830fd9-35f3-4a22-b480-8f31bd7940d3 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:26.163127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:26.164179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:26.164656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:26.165147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] PATH_INFO: `/v3/users/1a026a4b600044b68b6ecf86226bb264` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:26.167284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a026a4b600044b68b6ecf86226bb264)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:26.170513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:26.247464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a026a4b600044b68b6ecf86226bb264'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.248212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a026a4b600044b68b6ecf86226bb264'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.259870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a026a4b600044b68b6ecf86226bb264'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.275826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a026a4b600044b68b6ecf86226bb264'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.284277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5f5472e3-8118-44f3-890f-ac21d483bff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a026a4b600044b68b6ecf86226bb264'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.292442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1175/2313] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:26 2022] DELETE /identity/v3/users/1a026a4b600044b68b6ecf86226bb264 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:26.647207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:26.649734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:26.667254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91beeb7-f1ac-4777-901d-492913d0236a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:26.739693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:26.740360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:26.740645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:26.740945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] PATH_INFO: `/v3/projects/7dc543e4a54e46c9a79ffe12699feb16` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:26.742218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc543e4a54e46c9a79ffe12699feb16)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:26.744271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:26.796914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc543e4a54e46c9a79ffe12699feb16', 'request_id': 'req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.802934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc543e4a54e46c9a79ffe12699feb16', 'request_id': 'req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.809620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc543e4a54e46c9a79ffe12699feb16', 'request_id': 'req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.825794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] The token cache is being invalidate because project 7dc543e4a54e46c9a79ffe12699feb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:26.826079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.826817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8104d8c1-c54e-4df0-a2c5-4e013d225b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:26.828491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1139/2314] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:26 2022] DELETE /identity/v3/projects/7dc543e4a54e46c9a79ffe12699feb16 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:26.833771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:26.834023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:26.834321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:26.856943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:26.858211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:26.869848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:26.927673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1176/2315] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:26.938170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:26.938696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:26.939145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:26.972083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:26.973456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:26.982903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1140/2316] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:26.988029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:26.998791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2fa9-a987-4e75-990c-8b3c2c699a82 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.004834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.005473 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.005753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.006015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.006707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:27.007007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.008657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.023381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1177/2317] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:29:27.029023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.042350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d949ce-6a76-4d08-9bdd-a9d957e906f0 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.047730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.048479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.048888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.049250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.050186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.052462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.077357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:27.090158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1141/2318] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:27 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:27.094487 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.106214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15615a92-fe70-413a-a467-d6a78d8ea976 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.171275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.171895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.172180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.172423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.173117 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.175055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.200160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1178/2319] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:27 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:29:27.205065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.216576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3819a58-275b-49eb-b7ec-3e2729af0776 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.221416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.222052 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.222324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.222589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.223249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.224942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.238082 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1142/2320] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:27.244106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.262932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f222e7-5b79-4513-8b29-ce70830bd676 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.271220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ab167-6e65-4869-bc6b-da41a6d98072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.271930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ab167-6e65-4869-bc6b-da41a6d98072 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.272256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ab167-6e65-4869-bc6b-da41a6d98072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.272536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ab167-6e65-4869-bc6b-da41a6d98072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.273599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ab167-6e65-4869-bc6b-da41a6d98072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.275626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ab167-6e65-4869-bc6b-da41a6d98072 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.294800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1179/2321] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:27.300916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.313102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab840-529e-42ad-93d4-18b5b9a8e494 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.319375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.320058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.320336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.320606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] PATH_INFO: `/v3/projects/4c74713d14dd4775928f5f9c7e2b968e/users/edef1e4a69714c2f9cfd63525cd30ed1/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.339188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c74713d14dd4775928f5f9c7e2b968e, user_id=edef1e4a69714c2f9cfd63525cd30ed1, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.342402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.359929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1143/2322] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:27 2022] PUT /identity/v3/projects/4c74713d14dd4775928f5f9c7e2b968e/users/edef1e4a69714c2f9cfd63525cd30ed1/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:27.372136 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.372425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.372724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.405082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] MFA Rules not processed for user `edef1e4a69714c2f9cfd63525cd30ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:27.406690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:27.484270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1180/2323] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:27.489543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.562991 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472411-ac34-4a03-a7b6-001507fb2a5a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.568031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.568687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.568967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.569237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.569893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.571883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.604146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1144/2324] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:27 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:29:27.609100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.622297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b46b4-a9c9-495c-ba94-2b82f2b92c5d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.631839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:27.693705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.694344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.694624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.694894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.695543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.697579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.725410 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1181/2325] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:27 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:27.729912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.742436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0e6bb-dfb2-48da-84ca-76f770932d00 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.748013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.748837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.749218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.749580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.750365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.752107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.766164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1145/2326] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:27.770960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.783081 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27ae8-ffd0-4cf2-a020-3d057ccc0b87 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.788231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.788944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.789217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.789478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] PATH_INFO: `/v3/projects/3f4445d9ea2742ccbde070b11990dc1e/users/cd30bd6b5c164ee4b13ab6d1c832b26f/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.808342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4445d9ea2742ccbde070b11990dc1e, user_id=cd30bd6b5c164ee4b13ab6d1c832b26f, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.811408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.829226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1182/2327] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:27 2022] PUT /identity/v3/projects/3f4445d9ea2742ccbde070b11990dc1e/users/cd30bd6b5c164ee4b13ab6d1c832b26f/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:27.834241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.853706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578ee72-4e69-4f46-992a-b7c03685ff11 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.932254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae73469-28c5-4b3e-8eb5-7985e92bec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.932931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73469-28c5-4b3e-8eb5-7985e92bec49 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.933210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73469-28c5-4b3e-8eb5-7985e92bec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.933483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73469-28c5-4b3e-8eb5-7985e92bec49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.934215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae73469-28c5-4b3e-8eb5-7985e92bec49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.935951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae73469-28c5-4b3e-8eb5-7985e92bec49 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.947501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1146/2328] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:29:27.952829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:27.964248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4106de-16b2-45a3-9fbe-1d79b6198f03 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:27.969227 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:27.969928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:27.970204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:27.970482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] PATH_INFO: `/v3/projects/3f4445d9ea2742ccbde070b11990dc1e/users/cd30bd6b5c164ee4b13ab6d1c832b26f/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:27.972655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4445d9ea2742ccbde070b11990dc1e, user_id=cd30bd6b5c164ee4b13ab6d1c832b26f, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:27.975615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:27.989046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1183/2329] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:27 2022] PUT /identity/v3/projects/3f4445d9ea2742ccbde070b11990dc1e/users/cd30bd6b5c164ee4b13ab6d1c832b26f/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:28.001828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:28.002094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:28.002395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:28.035936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] MFA Rules not processed for user `cd30bd6b5c164ee4b13ab6d1c832b26f`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:28.037224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:28.061953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:28.119814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1147/2330] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:29:28.132242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:28.134160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:28.212598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834f6a-b7e2-4790-833d-7b7a049582c2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:28.216930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:28.217575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:28.217849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:28.218118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:28.228427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:28.229942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:28.241716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1184/2331] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:29:28.347702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:28.358599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588ef77-5a39-4593-a002-0ff3b6b4bb71 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:28.362680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0c116-d166-4300-99f9-21a06a4bac86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:28.363313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0c116-d166-4300-99f9-21a06a4bac86 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:28.363603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0c116-d166-4300-99f9-21a06a4bac86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:28.363874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0c116-d166-4300-99f9-21a06a4bac86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:28.431721 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0c116-d166-4300-99f9-21a06a4bac86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:28.433245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0c116-d166-4300-99f9-21a06a4bac86 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:28.444430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1148/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:31.449219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:31.527032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eddb9-3b3e-41c2-ab71-1211305cb081 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:31.533781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:31.534441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:31.534746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:31.534967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] PATH_INFO: `/v3/users/edef1e4a69714c2f9cfd63525cd30ed1` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:31.536559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=edef1e4a69714c2f9cfd63525cd30ed1)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:31.538589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:31.545628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:31.615833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edef1e4a69714c2f9cfd63525cd30ed1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:31.616608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edef1e4a69714c2f9cfd63525cd30ed1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:31.628202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edef1e4a69714c2f9cfd63525cd30ed1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:31.647797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edef1e4a69714c2f9cfd63525cd30ed1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:31.655729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edef1e4a69714c2f9cfd63525cd30ed1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:31.662401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1185/2333] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:31 2022] DELETE /identity/v3/users/edef1e4a69714c2f9cfd63525cd30ed1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:31.668421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:31.669092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:31.669454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:31.695794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:31.697088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:31.776109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1149/2334] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:31.788775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:31.790860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:31.867664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c132a-c5c7-4b2f-ab58-df708ce1a6ac admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:31.873863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:31.874883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:31.875288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:31.875746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:31.892995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:31.895836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:31.911206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1186/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:32.287309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:32.288962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:32.305267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44213e9-76c8-453f-9db2-1e90e2137bb3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:32.313473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:32.314494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:32.315419 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:32.315419 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] PATH_INFO: `/v3/projects/4c74713d14dd4775928f5f9c7e2b968e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:32.317698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c74713d14dd4775928f5f9c7e2b968e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:32.320301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:32.394250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c74713d14dd4775928f5f9c7e2b968e', 'request_id': 'req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.398051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:32.405916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c74713d14dd4775928f5f9c7e2b968e', 'request_id': 'req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.417310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c74713d14dd4775928f5f9c7e2b968e', 'request_id': 'req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.433974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] The token cache is being invalidate because project 4c74713d14dd4775928f5f9c7e2b968e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:32.435090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.435946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.437787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1150/2336] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:32 2022] DELETE /identity/v3/projects/4c74713d14dd4775928f5f9c7e2b968e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:32.442444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:32.454273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2143-2a3a-4886-b342-539bce077a2e service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:32.524195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:32.525073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:32.525461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:32.525776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] PATH_INFO: `/v3/users/cd30bd6b5c164ee4b13ab6d1c832b26f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:32.527101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd30bd6b5c164ee4b13ab6d1c832b26f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:32.529806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:32.585403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:32.603494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd30bd6b5c164ee4b13ab6d1c832b26f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.604244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd30bd6b5c164ee4b13ab6d1c832b26f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.619000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd30bd6b5c164ee4b13ab6d1c832b26f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.635088 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd30bd6b5c164ee4b13ab6d1c832b26f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.643788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5a103763-96b6-4c0c-8b6b-56923e055340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd30bd6b5c164ee4b13ab6d1c832b26f'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:32.655340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1187/2337] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:32 2022] DELETE /identity/v3/users/cd30bd6b5c164ee4b13ab6d1c832b26f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:33.071401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.073463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:33.091344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1ba5-9c9e-4651-a7f5-7ce0d9ff0f3e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.173525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.174101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.174375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.174651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] PATH_INFO: `/v3/projects/3f4445d9ea2742ccbde070b11990dc1e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.175896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4445d9ea2742ccbde070b11990dc1e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.177925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.236688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4445d9ea2742ccbde070b11990dc1e', 'request_id': 'req-dbdb99c9-7203-4595-88be-422b35fb7b7d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:33.244105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4445d9ea2742ccbde070b11990dc1e', 'request_id': 'req-dbdb99c9-7203-4595-88be-422b35fb7b7d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:33.252102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4445d9ea2742ccbde070b11990dc1e', 'request_id': 'req-dbdb99c9-7203-4595-88be-422b35fb7b7d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:33.269103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] The token cache is being invalidate because project 3f4445d9ea2742ccbde070b11990dc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:33.269396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:33.270165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-dbdb99c9-7203-4595-88be-422b35fb7b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:33.271819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1151/2338] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:33 2022] DELETE /identity/v3/projects/3f4445d9ea2742ccbde070b11990dc1e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:33.277218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.277535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.277808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.301140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:33.302719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:33.371047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1188/2339] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:33.379446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.379821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.380150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.402481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:33.403770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:33.416765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1152/2340] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:33.421613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.438500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed30f2-b3b5-470c-a6dd-fc4a5a0e4535 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.445087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.445702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.445974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.446255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.446905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:33.447187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.448910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.466362 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1189/2341] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:29:33.467652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.478216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c7f7-eac1-40b5-9903-19208134cd58 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.483090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.483708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.483987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.484251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.486156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.486903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.519852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1153/2342] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:33 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:33.524653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.542068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb9a1-b48d-4326-bdfa-87a695abc2c7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.638901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.639537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.639815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.640084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.640785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.642782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.673417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1190/2343] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:33 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:33.678624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.697357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3a2e2-ca2d-4f55-86f1-d1f12e5fcb81 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.705209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.706171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.706683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.707136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.708202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.711077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.729069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1154/2344] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:29:33.734219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.746198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7fbc-2e57-43a0-b8cc-076076321618 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.752255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167f0e-4d8d-4b71-9d47-a46e14ad7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.752926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167f0e-4d8d-4b71-9d47-a46e14ad7677 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.753207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167f0e-4d8d-4b71-9d47-a46e14ad7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.753481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167f0e-4d8d-4b71-9d47-a46e14ad7677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.754148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167f0e-4d8d-4b71-9d47-a46e14ad7677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.755799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167f0e-4d8d-4b71-9d47-a46e14ad7677 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.769889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1191/2345] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:33.774316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.785543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ce893-110d-4b52-b849-65bd75c02a31 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:33.790704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:33.791407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.791682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.792055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] PATH_INFO: `/v3/projects/9526cd050ef44e4c8983b5a333677fcc/users/f67879b088e0443caf35ac873a5a721d/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.810605 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9526cd050ef44e4c8983b5a333677fcc, user_id=f67879b088e0443caf35ac873a5a721d, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:33.813341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:33.831758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1155/2346] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:33 2022] PUT /identity/v3/projects/9526cd050ef44e4c8983b5a333677fcc/users/f67879b088e0443caf35ac873a5a721d/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:33.843080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:33.843315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:33.843641 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:33.883945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:33.887888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] MFA Rules not processed for user `f67879b088e0443caf35ac873a5a721d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:33.889774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:33.967771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1192/2347] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:33.972580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:33.983142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:34.057613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c2dc-e2ae-449e-bfaa-de1ccc15251f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.063308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.064002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.064326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.064660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.065454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.067569 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.101001 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1156/2348] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:33 2022] POST /identity/v3/projects => generated 395 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:34.106284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.120432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d98a9e-0118-47b7-8991-cd2479ea4c8e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.208264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.208967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.209246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.209515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.210189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.212212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.245245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1193/2349] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:34 2022] POST /identity/v3/users => generated 304 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:34.250867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.262806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea44de0-eb60-4a59-b784-42fc2ede6b19 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.270548 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.271838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.271838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.272274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.273217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.275453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.290977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1157/2350] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:34.295833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.306877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f780df-96e9-4365-977d-e8677e1f516a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.313000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.313694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.313980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.314242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] PATH_INFO: `/v3/projects/ddfae4855c204c67bc9555d6be16b41c/users/7dd98d29ff9c443c8b906d4a29c14a0d/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.333058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfae4855c204c67bc9555d6be16b41c, user_id=7dd98d29ff9c443c8b906d4a29c14a0d, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.335800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.353486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1194/2351] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:34 2022] PUT /identity/v3/projects/ddfae4855c204c67bc9555d6be16b41c/users/7dd98d29ff9c443c8b906d4a29c14a0d/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:34.358706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.377534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a550-9b1d-4343-a145-1c9aa10d00bb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.473992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d4d15-96c4-4231-9407-18694ee78747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.474740 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4d15-96c4-4231-9407-18694ee78747 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.475022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4d15-96c4-4231-9407-18694ee78747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.475311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4d15-96c4-4231-9407-18694ee78747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.476245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d4d15-96c4-4231-9407-18694ee78747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.478366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d4d15-96c4-4231-9407-18694ee78747 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.497279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1158/2352] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:34.501536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.513956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6890d-427f-40d7-b4f4-e19f3c2c333a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.519198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.519881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.520153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.520425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] PATH_INFO: `/v3/projects/ddfae4855c204c67bc9555d6be16b41c/users/7dd98d29ff9c443c8b906d4a29c14a0d/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.522510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfae4855c204c67bc9555d6be16b41c, user_id=7dd98d29ff9c443c8b906d4a29c14a0d, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.525273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.538526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1195/2353] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:34 2022] PUT /identity/v3/projects/ddfae4855c204c67bc9555d6be16b41c/users/7dd98d29ff9c443c8b906d4a29c14a0d/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:34.551356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.551702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.551890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.587044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] MFA Rules not processed for user `7dd98d29ff9c443c8b906d4a29c14a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:34.588364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:34.684209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1159/2354] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:29:34.702057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.704778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:34.798403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc9f28-170a-4d99-aa68-723fff5ef2c3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.805276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.806098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.806445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.806837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:34.818773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:34.820512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:34.825745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:34.836423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1196/2355] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:34.939391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:34.945124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:34.952346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf3d1-77bd-4727-b1f0-9c76266a0c68 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:34.956986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adb373-89b2-44af-9193-2b266de55e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:34.957620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb373-89b2-44af-9193-2b266de55e90 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:34.957904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb373-89b2-44af-9193-2b266de55e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:34.958180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb373-89b2-44af-9193-2b266de55e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:35.030962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adb373-89b2-44af-9193-2b266de55e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:35.032328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adb373-89b2-44af-9193-2b266de55e90 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:35.043529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1160/2356] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:39.304758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:39.384357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06b3b5-8be5-4f1c-a0f5-1743cb42af8a service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:39.390595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:39.391349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:39.391736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:39.392152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] PATH_INFO: `/v3/users/f67879b088e0443caf35ac873a5a721d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:39.396029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67879b088e0443caf35ac873a5a721d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:39.396029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:39.461277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67879b088e0443caf35ac873a5a721d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:39.462323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67879b088e0443caf35ac873a5a721d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:39.474708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67879b088e0443caf35ac873a5a721d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:39.489716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67879b088e0443caf35ac873a5a721d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:39.498698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67879b088e0443caf35ac873a5a721d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:39.508866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1197/2357] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:39 2022] DELETE /identity/v3/users/f67879b088e0443caf35ac873a5a721d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:39.510837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:39.511472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:39.511472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:39.538608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:39.540139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:39.616556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1161/2358] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:39.628262 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:39.629992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:39.745551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6dae0-525a-41a7-b01a-2a1348f7b7e4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:39.754621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:39.755500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:39.755772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:39.756039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:39.767080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:39.768561 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:39.779936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1198/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:29:40.124752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:40.126644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:40.141857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded0756-5db2-4fc4-94a2-e8683114b134 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:40.147012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:40.147722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:40.147912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:40.148196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] PATH_INFO: `/v3/projects/9526cd050ef44e4c8983b5a333677fcc` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:40.149397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9526cd050ef44e4c8983b5a333677fcc)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:40.151311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:40.205327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9526cd050ef44e4c8983b5a333677fcc', 'request_id': 'req-8a17c599-9e38-4f3e-8824-53d006a790e5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.213157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9526cd050ef44e4c8983b5a333677fcc', 'request_id': 'req-8a17c599-9e38-4f3e-8824-53d006a790e5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.221299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9526cd050ef44e4c8983b5a333677fcc', 'request_id': 'req-8a17c599-9e38-4f3e-8824-53d006a790e5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.237273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] The token cache is being invalidate because project 9526cd050ef44e4c8983b5a333677fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:40.237564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.238251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.239796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1162/2360] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:40 2022] DELETE /identity/v3/projects/9526cd050ef44e4c8983b5a333677fcc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:40.244376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:40.254856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64790f-5626-43db-9dae-8928e252141d service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:40.273828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:40.325692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:40.326581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:40.326909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:40.327247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] PATH_INFO: `/v3/users/7dd98d29ff9c443c8b906d4a29c14a0d` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:40.328511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd98d29ff9c443c8b906d4a29c14a0d)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:40.330515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:40.386889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd98d29ff9c443c8b906d4a29c14a0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.387459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd98d29ff9c443c8b906d4a29c14a0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.398968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd98d29ff9c443c8b906d4a29c14a0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.415906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd98d29ff9c443c8b906d4a29c14a0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.424713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-116361f3-17de-4e66-90da-aaeaa14724d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd98d29ff9c443c8b906d4a29c14a0d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.434383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1199/2361] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:40 2022] DELETE /identity/v3/users/7dd98d29ff9c443c8b906d4a29c14a0d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:40.774199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:40.776179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:40.801850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17c599-9e38-4f3e-8824-53d006a790e5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:40.842752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:40.890075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:40.890717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:40.891005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:40.891273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] PATH_INFO: `/v3/projects/ddfae4855c204c67bc9555d6be16b41c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:40.892942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfae4855c204c67bc9555d6be16b41c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:40.894425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:40.952247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfae4855c204c67bc9555d6be16b41c', 'request_id': 'req-6b850dce-6198-4c21-9d76-5f581ef67c7e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.958840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfae4855c204c67bc9555d6be16b41c', 'request_id': 'req-6b850dce-6198-4c21-9d76-5f581ef67c7e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.967114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfae4855c204c67bc9555d6be16b41c', 'request_id': 'req-6b850dce-6198-4c21-9d76-5f581ef67c7e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.984308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] The token cache is being invalidate because project ddfae4855c204c67bc9555d6be16b41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:40.984608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.985393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6b850dce-6198-4c21-9d76-5f581ef67c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:40.987655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1163/2362] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:40 2022] DELETE /identity/v3/projects/ddfae4855c204c67bc9555d6be16b41c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:40.992452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:40.992854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:40.993194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.016104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:41.017389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:41.090261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1200/2363] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:41.098609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890a3e-c902-4467-84df-d938099758ab None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.098880 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890a3e-c902-4467-84df-d938099758ab None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.099150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890a3e-c902-4467-84df-d938099758ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.121633 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a0890a3e-c902-4467-84df-d938099758ab None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:41.122872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a0890a3e-c902-4467-84df-d938099758ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:41.131287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1164/2364] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:41.135838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.146122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8daae9-c0b1-4dc1-bf43-f443b47c4e87 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.151242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.151868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.152195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.152500 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.153226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:41.153525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.155164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.168715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1201/2365] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:29:41.173459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890a3e-c902-4467-84df-d938099758ab None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.183201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890a3e-c902-4467-84df-d938099758ab None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.189210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.189889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.190160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.190426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.191064 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.193010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.226733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1165/2366] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:41 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:41.232003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.243183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba515-e877-4259-9b42-93f77f32e125 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.269459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:41.309538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.310465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.310869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.311251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.311986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.313995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.338245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1202/2367] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:41 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:41.342823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.354977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073999c6-3df2-4e51-86df-171f574674d1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.361035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.361684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.362292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.362558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.363212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.364872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.376351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1166/2368] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:41.380879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.391760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a067-151e-42a1-8876-6f2cfc85d57f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.396943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2887090-2227-428e-9820-612d0206d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.397620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887090-2227-428e-9820-612d0206d5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.397898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887090-2227-428e-9820-612d0206d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.398155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887090-2227-428e-9820-612d0206d5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.398806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2887090-2227-428e-9820-612d0206d5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.400451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2887090-2227-428e-9820-612d0206d5e9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.412664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1203/2369] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:41.418092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.429258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47a28-a16c-4745-a268-722c322c9a72 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.435279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.435959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.436230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.436509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] PATH_INFO: `/v3/projects/ae147dda881b464396e0b2482035a3b2/users/d350b91721b047ae88244a17b420b977/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.454667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae147dda881b464396e0b2482035a3b2, user_id=d350b91721b047ae88244a17b420b977, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.460066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.475587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1167/2370] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:41 2022] PUT /identity/v3/projects/ae147dda881b464396e0b2482035a3b2/users/d350b91721b047ae88244a17b420b977/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:41.486599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.487153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.487396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.517610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] MFA Rules not processed for user `d350b91721b047ae88244a17b420b977`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:41.518826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:41.591803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1204/2371] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:41.596505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.656788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:41.669408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877169e8-0e24-4d26-b60f-78f71c956cd3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.675919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.676546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.676860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.677128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.677760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.679684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.713218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1168/2372] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:41 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:41.718593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.732272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3586151-f8bf-4e80-99e7-e6f6795ffbc1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.800737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.801325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.801570 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.801868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.802546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.804472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.834424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1205/2373] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:41 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:41.838567 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.851195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbb06-1e92-43f2-9002-48f072fa866d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.856340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.857679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.857962 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.858259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.858911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.860519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.877811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1169/2374] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:41.882426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.894020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135d44a-680a-401c-ad38-cca5e0a69cd2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:41.899903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:41.900598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:41.900905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:41.901175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] PATH_INFO: `/v3/projects/f97f3c4f391c4f1ca8e3b1698722e476/users/f22351a3c2e943f492afec86313aed24/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:41.918633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97f3c4f391c4f1ca8e3b1698722e476, user_id=f22351a3c2e943f492afec86313aed24, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:41.921710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:41.933009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:41.939505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1206/2375] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:41 2022] PUT /identity/v3/projects/f97f3c4f391c4f1ca8e3b1698722e476/users/f22351a3c2e943f492afec86313aed24/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:41.944561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:41.956923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4bab7-965e-45cf-a339-a1b6488af700 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:42.037536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d5c8d-a4fb-4483-bb63-22a7bf77034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:42.038389 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5c8d-a4fb-4483-bb63-22a7bf77034e admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:42.039117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5c8d-a4fb-4483-bb63-22a7bf77034e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:42.039117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5c8d-a4fb-4483-bb63-22a7bf77034e admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:42.039590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d5c8d-a4fb-4483-bb63-22a7bf77034e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:42.041286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d5c8d-a4fb-4483-bb63-22a7bf77034e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:42.053791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1170/2376] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:29:42.058252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:42.070879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77166-65c9-4256-a9af-e4282c12076b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:42.078073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:42.079245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:42.079723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:42.080172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] PATH_INFO: `/v3/projects/f97f3c4f391c4f1ca8e3b1698722e476/users/f22351a3c2e943f492afec86313aed24/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:42.083943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97f3c4f391c4f1ca8e3b1698722e476, user_id=f22351a3c2e943f492afec86313aed24, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:42.089374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:42.107188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1207/2377] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:42 2022] PUT /identity/v3/projects/f97f3c4f391c4f1ca8e3b1698722e476/users/f22351a3c2e943f492afec86313aed24/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:42.180169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:42.180713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:42.181239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:42.219688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] MFA Rules not processed for user `f22351a3c2e943f492afec86313aed24`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:42.220967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:42.302717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1171/2378] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:42.315463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:42.317551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:42.385822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841863-9bf7-437f-bbe8-904db6c70232 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:42.390135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0927ce8-5820-408b-9d62-6a3a02775df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:42.390763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0927ce8-5820-408b-9d62-6a3a02775df9 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:42.391031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0927ce8-5820-408b-9d62-6a3a02775df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:42.391295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0927ce8-5820-408b-9d62-6a3a02775df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:42.453448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0927ce8-5820-408b-9d62-6a3a02775df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:42.454893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0927ce8-5820-408b-9d62-6a3a02775df9 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:42.465270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1208/2379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:45.120162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:45.178533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:45.198215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ba190-7ccc-4cd1-a876-6493324537a2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:45.203310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:45.203989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:45.204267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:45.204547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] PATH_INFO: `/v3/users/d350b91721b047ae88244a17b420b977` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:45.205907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d350b91721b047ae88244a17b420b977)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:45.207984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:45.276500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd350b91721b047ae88244a17b420b977'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.287002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd350b91721b047ae88244a17b420b977'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.287798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd350b91721b047ae88244a17b420b977'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.302545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd350b91721b047ae88244a17b420b977'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.311277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd350b91721b047ae88244a17b420b977'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.320254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1172/2380] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:45 2022] DELETE /identity/v3/users/d350b91721b047ae88244a17b420b977 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:45.325326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8c0e-300a-47da-a671-4426046f548d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:45.326271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8c0e-300a-47da-a671-4426046f548d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:45.326271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8c0e-300a-47da-a671-4426046f548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:45.347935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-844f8c0e-300a-47da-a671-4426046f548d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:45.349247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-844f8c0e-300a-47da-a671-4426046f548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:45.419885 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1209/2381] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:45.430454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:45.432159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:45.505969 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67134db8-de3e-42dc-8cb8-c107a347c85c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:45.510237 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:45.510864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:45.511142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:45.511383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:45.521410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:45.522891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:45.533950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1173/2382] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:45.843511 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8c0e-300a-47da-a671-4426046f548d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:45.845360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-844f8c0e-300a-47da-a671-4426046f548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:45.862264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8c0e-300a-47da-a671-4426046f548d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:45.867721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:45.869051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:45.869336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:45.869605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] PATH_INFO: `/v3/projects/ae147dda881b464396e0b2482035a3b2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:45.871205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae147dda881b464396e0b2482035a3b2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:45.874451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:45.920188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:45.932075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae147dda881b464396e0b2482035a3b2', 'request_id': 'req-cfce0a61-d379-4928-9caa-b68d723d7adc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.939820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae147dda881b464396e0b2482035a3b2', 'request_id': 'req-cfce0a61-d379-4928-9caa-b68d723d7adc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.953735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae147dda881b464396e0b2482035a3b2', 'request_id': 'req-cfce0a61-d379-4928-9caa-b68d723d7adc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.966532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] The token cache is being invalidate because project ae147dda881b464396e0b2482035a3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:45.966820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.967530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:45.969174 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1210/2383] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:45 2022] DELETE /identity/v3/projects/ae147dda881b464396e0b2482035a3b2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:45.974970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:45.985995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653243da-c746-467e-910d-726b0bc24a27 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:46.051256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:46.051913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:46.052191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:46.052465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] PATH_INFO: `/v3/users/f22351a3c2e943f492afec86313aed24` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:46.053666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22351a3c2e943f492afec86313aed24)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:46.055618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:46.067000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:46.120408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22351a3c2e943f492afec86313aed24'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.130289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22351a3c2e943f492afec86313aed24'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.131049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22351a3c2e943f492afec86313aed24'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.146851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22351a3c2e943f492afec86313aed24'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.155108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed9b95ec-0cfe-4149-bd2e-f917a78a6043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22351a3c2e943f492afec86313aed24'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.163252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1174/2384] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:29:45 2022] DELETE /identity/v3/users/f22351a3c2e943f492afec86313aed24 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:29:46.488470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:46.489985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:46.503859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce0a61-d379-4928-9caa-b68d723d7adc admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:46.581306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:46.581967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:46.582491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:46.582491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] PATH_INFO: `/v3/projects/f97f3c4f391c4f1ca8e3b1698722e476` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:46.583657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97f3c4f391c4f1ca8e3b1698722e476)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:46.585711 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:46.638871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97f3c4f391c4f1ca8e3b1698722e476', 'request_id': 'req-df00a488-ccb4-4094-a086-c7b7d2e29436'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.645682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97f3c4f391c4f1ca8e3b1698722e476', 'request_id': 'req-df00a488-ccb4-4094-a086-c7b7d2e29436'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.656452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97f3c4f391c4f1ca8e3b1698722e476', 'request_id': 'req-df00a488-ccb4-4094-a086-c7b7d2e29436'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.674243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] The token cache is being invalidate because project f97f3c4f391c4f1ca8e3b1698722e476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:29:46.674573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.675271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df00a488-ccb4-4094-a086-c7b7d2e29436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:29:46.676876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1211/2385] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:29:46 2022] DELETE /identity/v3/projects/f97f3c4f391c4f1ca8e3b1698722e476 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:46.682337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:46.682620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:46.682891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:46.704313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:46.705618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:46.774645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1175/2386] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:29:46.782808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:46.783127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:46.783354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:46.806317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:46.807560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:46.817554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1212/2387] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:46.822134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:46.833008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84ec1-c890-4134-a172-025cf8dd5147 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:46.838496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:46.839230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:46.839574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:46.839950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:46.840696 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:29:46.841083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:46.842872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:46.856572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1176/2388] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:29:46.861287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:46.871646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44eec3-903f-4d06-9e42-29820a500fab None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:46.876907 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:46.877529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:46.877806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:46.878220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:46.878878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:46.880839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:46.922662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1213/2389] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:29:46 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:46.924794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:46.942650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e050-cf08-4ac0-b4cc-51aa11b4edfd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:47.029527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:47.030165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:47.030442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:47.030713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:47.031361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:47.033451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:47.059329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1177/2390] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:29:46 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:29:47.064172 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:47.076209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fb65-7194-492c-96cc-0679482bf3f1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:47.081703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:47.082345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:47.082617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:47.082887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:47.083551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:47.085276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:47.098529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1214/2391] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:29:47.103210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:47.111035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:47.116042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563df49-1ffc-4534-9b6d-78a4e8ee64a3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:47.123434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b49970-0657-4fe6-9234-66d3672e8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:47.124859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b49970-0657-4fe6-9234-66d3672e8586 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:47.125704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b49970-0657-4fe6-9234-66d3672e8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:47.126036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b49970-0657-4fe6-9234-66d3672e8586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:47.126791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b49970-0657-4fe6-9234-66d3672e8586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:47.128576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b49970-0657-4fe6-9234-66d3672e8586 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:47.147126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1178/2392] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:29:47.152679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:47.164216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e869a-6b6a-4f1b-80c7-9269adccfd99 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:47.170551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:47.171417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:47.171707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:47.171973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] PATH_INFO: `/v3/projects/1cfef3a198654f108cffcee3aea71412/users/5dfa23fab14448dcbe91413592e5c153/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:47.195682 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:47.199855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfef3a198654f108cffcee3aea71412, user_id=5dfa23fab14448dcbe91413592e5c153, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:47.202809 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:47.220201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1215/2393] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:29:47 2022] PUT /identity/v3/projects/1cfef3a198654f108cffcee3aea71412/users/5dfa23fab14448dcbe91413592e5c153/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:29:47.232989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:47.233317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:47.233631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:47.265983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] MFA Rules not processed for user `5dfa23fab14448dcbe91413592e5c153`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:29:47.267238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:47.336454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1179/2394] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:29:47.349123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:29:47.350918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:29:47.412612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e828d-2aab-4b77-8564-32f6df25ce6e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:29:47.416672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f94f4-811d-4933-a601-495fd810369a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:29:47.417322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f94f4-811d-4933-a601-495fd810369a service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:29:47.417595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f94f4-811d-4933-a601-495fd810369a service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:29:47.418012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f94f4-811d-4933-a601-495fd810369a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:29:47.427621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f94f4-811d-4933-a601-495fd810369a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:29:47.429133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f94f4-811d-4933-a601-495fd810369a service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:29:47.439223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1216/2395] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:29:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:29:57.333458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=35 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:57.434543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:01.357908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:01.442825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934daa1a-2a0b-49a5-b951-8109a83f3374 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:01.447724 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:01.448377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:01.448684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:01.448965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] PATH_INFO: `/v3/users/5dfa23fab14448dcbe91413592e5c153` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:01.450270 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfa23fab14448dcbe91413592e5c153)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:01.452289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:01.509279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfa23fab14448dcbe91413592e5c153'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:01.519097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfa23fab14448dcbe91413592e5c153'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:01.519732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfa23fab14448dcbe91413592e5c153'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:01.533604 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfa23fab14448dcbe91413592e5c153'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:01.543504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfa23fab14448dcbe91413592e5c153'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:01.552074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1180/2396] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:30:01 2022] DELETE /identity/v3/users/5dfa23fab14448dcbe91413592e5c153 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:30:01.559161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:01.559781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:01.559781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:01.581240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:01.582459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:01.647056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1217/2397] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:01.659162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:01.662128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:01.746806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8137d-f07b-4ce8-8b3c-77efb2c4a0ab admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:01.751080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285e6e-8086-4405-b331-f20facc0487b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:01.751718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285e6e-8086-4405-b331-f20facc0487b service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:01.752210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285e6e-8086-4405-b331-f20facc0487b service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:01.752337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285e6e-8086-4405-b331-f20facc0487b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:01.766145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285e6e-8086-4405-b331-f20facc0487b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:01.767612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285e6e-8086-4405-b331-f20facc0487b service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:01.778305 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1181/2398] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:30:02.086164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.087728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:02.101434 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df77296-ede1-4219-9ff0-f39d7f94370c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.107778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.108796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.109125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.109577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] PATH_INFO: `/v3/projects/1cfef3a198654f108cffcee3aea71412` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.110889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfef3a198654f108cffcee3aea71412)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.113417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.172757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfef3a198654f108cffcee3aea71412', 'request_id': 'req-f85ec324-9f4f-45eb-897a-eb0d62d895cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:02.179496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfef3a198654f108cffcee3aea71412', 'request_id': 'req-f85ec324-9f4f-45eb-897a-eb0d62d895cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:02.188850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfef3a198654f108cffcee3aea71412', 'request_id': 'req-f85ec324-9f4f-45eb-897a-eb0d62d895cc'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:02.200513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] The token cache is being invalidate because project 1cfef3a198654f108cffcee3aea71412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:30:02.200838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:02.201501 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f85ec324-9f4f-45eb-897a-eb0d62d895cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:02.203047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1218/2399] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:30:02 2022] DELETE /identity/v3/projects/1cfef3a198654f108cffcee3aea71412 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:30:02.208018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.208299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.208577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.228563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:02.229802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:02.247867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:02.292197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1182/2400] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:02.300297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.300580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.300884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.321752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:02.322960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:02.332086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1219/2401] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:02.336600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.346656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cef64c-93d1-404e-abce-a954dbcfc9e5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.351782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.352417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.352723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.352994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.353644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:30:02.353939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.356124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.369306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1183/2402] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:30:02.374620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.387860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5b65-be13-4b81-b6ef-97836c890242 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.393130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.393773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.394044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.394310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.395221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.396928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.429867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1220/2403] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:30:02 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:30:02.433995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.445384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7bf7-d31f-46ff-b61c-d8d6f287e83b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.508226 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.508873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.509141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.509414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.510050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.512217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.539320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1184/2404] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:30:02 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:30:02.544538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.559930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f701fd-8864-4842-a71d-9d47fbc8c076 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.565345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.565965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.566238 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.566510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.567191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.568868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.580261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1221/2405] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:30:02.584681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.595035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e31c4-bfe1-4a72-aa45-53cdb23c8e43 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.600322 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4cdb0-8609-43bd-8bca-30f2440d7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.600981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4cdb0-8609-43bd-8bca-30f2440d7c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.601264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4cdb0-8609-43bd-8bca-30f2440d7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.601541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4cdb0-8609-43bd-8bca-30f2440d7c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.602192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4cdb0-8609-43bd-8bca-30f2440d7c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.603812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4cdb0-8609-43bd-8bca-30f2440d7c51 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.616321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1185/2406] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:30:02.620906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.634742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d276-1567-4bb1-96c1-bdaea4ff9ba0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.641026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.641918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.642331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.642606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] PATH_INFO: `/v3/projects/5b418ef91586478e8f3f004a982a8994/users/2208e260f7184f13bc2ea5ab5873a3ba/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.661467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b418ef91586478e8f3f004a982a8994, user_id=2208e260f7184f13bc2ea5ab5873a3ba, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.664153 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.679659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1222/2407] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:30:02 2022] PUT /identity/v3/projects/5b418ef91586478e8f3f004a982a8994/users/2208e260f7184f13bc2ea5ab5873a3ba/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:30:02.690602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.690855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.691155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.723394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] MFA Rules not processed for user `2208e260f7184f13bc2ea5ab5873a3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:02.724712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:02.795965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1186/2408] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:30:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:30:02.807825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:02.809833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:02.832299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:02.872694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9f02-1ec5-484b-adaa-9e084f648a78 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:02.876908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89aa40-989f-47fc-a4d5-f80f1cd060dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:02.877527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89aa40-989f-47fc-a4d5-f80f1cd060dd service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:02.877806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89aa40-989f-47fc-a4d5-f80f1cd060dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:02.878080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89aa40-989f-47fc-a4d5-f80f1cd060dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:02.887908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89aa40-989f-47fc-a4d5-f80f1cd060dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:02.889388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89aa40-989f-47fc-a4d5-f80f1cd060dd service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:02.899122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1223/2409] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:30:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:30:08.054513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:08.081698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:08.136540 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6092-148a-46e8-b709-20aab1a3df70 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:08.144963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:08.145636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:08.145917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:08.146189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] PATH_INFO: `/v3/users/2208e260f7184f13bc2ea5ab5873a3ba` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:08.147387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2208e260f7184f13bc2ea5ab5873a3ba)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:08.149898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:08.244450 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2208e260f7184f13bc2ea5ab5873a3ba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.254211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2208e260f7184f13bc2ea5ab5873a3ba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.254897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2208e260f7184f13bc2ea5ab5873a3ba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.268898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2208e260f7184f13bc2ea5ab5873a3ba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.276804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2208e260f7184f13bc2ea5ab5873a3ba'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.284279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1187/2410] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:30:08 2022] DELETE /identity/v3/users/2208e260f7184f13bc2ea5ab5873a3ba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:30:08.288831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:08.289547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:08.289547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:08.310606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:08.311874 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:08.388213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1224/2411] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:08.396278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:08.398394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:08.471176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459942-94ac-466c-a841-e9dc5de76741 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:08.475214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745558e6-4d7b-4078-8573-d5c35f4bd355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:08.475853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745558e6-4d7b-4078-8573-d5c35f4bd355 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:08.476126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745558e6-4d7b-4078-8573-d5c35f4bd355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:08.476394 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745558e6-4d7b-4078-8573-d5c35f4bd355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:08.488867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745558e6-4d7b-4078-8573-d5c35f4bd355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:08.490619 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745558e6-4d7b-4078-8573-d5c35f4bd355 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:08.502516 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1188/2412] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:30:08.851630 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:08.853157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:08.868363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ef281-bd77-4618-b488-c86efa7f4393 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:08.874539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:08.875416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:08.875696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:08.875996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] PATH_INFO: `/v3/projects/5b418ef91586478e8f3f004a982a8994` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:08.877535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b418ef91586478e8f3f004a982a8994)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:08.879675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:08.943302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b418ef91586478e8f3f004a982a8994', 'request_id': 'req-571dca6d-b32a-4282-9d25-3860be20deee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.951261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b418ef91586478e8f3f004a982a8994', 'request_id': 'req-571dca6d-b32a-4282-9d25-3860be20deee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.964280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b418ef91586478e8f3f004a982a8994', 'request_id': 'req-571dca6d-b32a-4282-9d25-3860be20deee'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.976990 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] The token cache is being invalidate because project 5b418ef91586478e8f3f004a982a8994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:30:08.977279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.978022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-571dca6d-b32a-4282-9d25-3860be20deee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:30:08.979654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1225/2413] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:30:08 2022] DELETE /identity/v3/projects/5b418ef91586478e8f3f004a982a8994 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:30:18.498068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:18.571498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:18.571784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:18.572060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:18.593802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] MFA Rules not processed for user `8c8ad3919d764781a90420e48c65df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:18.595008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:18.675083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1189/2414] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:30:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:18.973310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:28.666562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=25 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:34.429127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:34.429738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:34.430363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:34.471783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:34.473732 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:34.561180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1226/2415] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:34.616513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:34.619326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:34.699084 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b0f54-c080-4ecc-b363-93ea3f0edce5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:34.704460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793be17-d2d8-4495-816c-dcc3fea04d53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:34.705136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793be17-d2d8-4495-816c-dcc3fea04d53 service swift] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:34.705410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793be17-d2d8-4495-816c-dcc3fea04d53 service swift] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:34.705678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793be17-d2d8-4495-816c-dcc3fea04d53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:34.715033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793be17-d2d8-4495-816c-dcc3fea04d53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:34.717794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793be17-d2d8-4495-816c-dcc3fea04d53 service swift] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:34.732124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1190/2416] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:30:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:44.554024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=32 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:44.728827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=32 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:50.391235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:50.392942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:50.505457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beb655-a364-4d00-bffb-41013b76d09f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:50.513497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:50.514642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:50.515116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:50.515558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:50.518433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:50.537156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:50.538866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:50.550729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1227/2417] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:30:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:30:57.794425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a212e04-eee9-4be7-9f14-ee9e06b3545c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:57.795273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a212e04-eee9-4be7-9f14-ee9e06b3545c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:57.795273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a212e04-eee9-4be7-9f14-ee9e06b3545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:57.820550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4a212e04-eee9-4be7-9f14-ee9e06b3545c None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:30:57.822361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4a212e04-eee9-4be7-9f14-ee9e06b3545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:30:57.834911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1191/2418] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:30:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:30:57.853794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:30:57.868498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b359-7150-411f-b213-d8a737d36fa1 service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:30:57.875156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:30:57.875931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:30:57.876320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:30:57.876653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:30:57.887806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:30:57.890095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:30:57.899971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1228/2419] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:30:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:31:07.813577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:07.896122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=47 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:19.938601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfdef-7649-4ce2-929b-c77fbcbfd876 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:19.939209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfdef-7649-4ce2-929b-c77fbcbfd876 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:19.940592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfdef-7649-4ce2-929b-c77fbcbfd876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:19.971056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8f5bfdef-7649-4ce2-929b-c77fbcbfd876 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:19.973181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8f5bfdef-7649-4ce2-929b-c77fbcbfd876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:19.984820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1192/2420] 10.222.0.57 () {58 vars in 967 bytes} [Thu Sep 1 05:31:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:20.008916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:20.021402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca433-201a-4972-9de1-d310fe2391f9 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:20.027225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:20.027930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:20.028272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:20.028665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:20.046691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:20.048376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:20.058291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1229/2421] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:31:23.073509 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:23.074129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:23.074129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:23.122702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:23.125213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:23.140795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1193/2422] 10.222.0.57 () {58 vars in 967 bytes} [Thu Sep 1 05:31:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:23.156594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:23.167544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6338-71de-4a2f-9e03-0132b5f97bf9 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:23.173056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:23.173652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:23.174115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:23.174545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:23.184058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:23.185728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:23.195769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1230/2423] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:31:24.480227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:24.494571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eddce-546c-4741-b2ae-38f530091653 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:24.503968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:24.504674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:24.505144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:24.505401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:24.507116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:24.524982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:24.527136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:24.553537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1194/2424] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:31:28.933945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:28.936019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:28.956567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e04af-c0a2-488d-8e45-291ff278d79d service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:28.966433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:28.967548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:28.968586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:28.969715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:28.972983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:28.996530 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:28.999754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:29.013070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:29.016002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:29.060684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1231/2425] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:31:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:31:29.212709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c3f7-3bcf-45ef-b3f2-157f6cdd2e6a service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:29.218638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:29.219606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:29.220045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:29.220480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] PATH_INFO: `/v3/users/f8dc78d4023c445cb31787a601f912d5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:29.222155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8dc78d4023c445cb31787a601f912d5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:29.225634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:29.293260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8dc78d4023c445cb31787a601f912d5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.304348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8dc78d4023c445cb31787a601f912d5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.308197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8dc78d4023c445cb31787a601f912d5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.328445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8dc78d4023c445cb31787a601f912d5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.336357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8dc78d4023c445cb31787a601f912d5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.343289 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1195/2426] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:31:29 2022] DELETE /identity/v3/users/f8dc78d4023c445cb31787a601f912d5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:29.591681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:29.613702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bb75b-4520-4828-8cb0-252151027917 service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:29.699587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:29.700246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:29.700508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:29.701010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] PATH_INFO: `/v3/projects/aa9b1ca8d4104ba88294e4410f13ac1f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:29.702843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9b1ca8d4104ba88294e4410f13ac1f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:29.704949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:29.796872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9b1ca8d4104ba88294e4410f13ac1f', 'request_id': 'req-8414e157-d678-476a-90f5-8477e284eefe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.810200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9b1ca8d4104ba88294e4410f13ac1f', 'request_id': 'req-8414e157-d678-476a-90f5-8477e284eefe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.832782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9b1ca8d4104ba88294e4410f13ac1f', 'request_id': 'req-8414e157-d678-476a-90f5-8477e284eefe'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.858663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] The token cache is being invalidate because project aa9b1ca8d4104ba88294e4410f13ac1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:31:29.858663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.859849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:29.864109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1232/2427] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:31:29 2022] DELETE /identity/v3/projects/aa9b1ca8d4104ba88294e4410f13ac1f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:29.871925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:29.875104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:29.903941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf76d-78c5-4082-b84a-bfb1ac83bb78 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:30.021380 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:30.035573 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:30.037564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:30.038425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:30.038845 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] PATH_INFO: `/v3/users/a2edcf64273f456b8086961ec9b7781b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:30.040432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2edcf64273f456b8086961ec9b7781b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:30.042885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:30.113623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2edcf64273f456b8086961ec9b7781b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.125068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2edcf64273f456b8086961ec9b7781b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.125951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2edcf64273f456b8086961ec9b7781b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.144214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2edcf64273f456b8086961ec9b7781b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.154037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2edcf64273f456b8086961ec9b7781b'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.173235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1196/2428] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:31:29 2022] DELETE /identity/v3/users/a2edcf64273f456b8086961ec9b7781b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:30.388278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:30.391212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:30.413206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e157-d678-476a-90f5-8477e284eefe admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:30.484204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:30.500795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:30.502259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:30.502888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:30.503442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] PATH_INFO: `/v3/projects/c64e37506ae74aae9a4692e4dbd3e4d9` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:30.506939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64e37506ae74aae9a4692e4dbd3e4d9)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:30.510276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:30.572562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64e37506ae74aae9a4692e4dbd3e4d9', 'request_id': 'req-aa0d84a7-3f6f-405f-8bca-1158d5544be6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.580843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64e37506ae74aae9a4692e4dbd3e4d9', 'request_id': 'req-aa0d84a7-3f6f-405f-8bca-1158d5544be6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.593061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64e37506ae74aae9a4692e4dbd3e4d9', 'request_id': 'req-aa0d84a7-3f6f-405f-8bca-1158d5544be6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.616356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] The token cache is being invalidate because project c64e37506ae74aae9a4692e4dbd3e4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:31:30.617059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.618200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:30.620852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1233/2429] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:31:30 2022] DELETE /identity/v3/projects/c64e37506ae74aae9a4692e4dbd3e4d9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:35.356195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:35.357215 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:35.448823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904c5d5-1c42-4974-9acd-fe6719114eea admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:35.503544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:35.504170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:35.504453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:35.504769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:35.506655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:35.562102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:35.597381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:35.598855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:35.610743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1197/2430] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:31:39.478796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:39.480851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:39.498102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d84a7-3f6f-405f-8bca-1158d5544be6 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:39.504778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:39.505914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:39.506429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:39.506908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] PATH_INFO: `/v3/users/3d27e93db5ec41e29196e6ff64608b96` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:39.508844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d27e93db5ec41e29196e6ff64608b96)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:39.512092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:39.581495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d27e93db5ec41e29196e6ff64608b96'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:39.582282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d27e93db5ec41e29196e6ff64608b96'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:39.594351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d27e93db5ec41e29196e6ff64608b96'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:39.610646 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d27e93db5ec41e29196e6ff64608b96'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:39.623841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-5b56c732-744b-45ac-8bce-e8c3d5843e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d27e93db5ec41e29196e6ff64608b96'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:39.632433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1234/2431] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:31:39 2022] DELETE /identity/v3/users/3d27e93db5ec41e29196e6ff64608b96 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:31:39.863398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:39.876309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef03f8-22cc-4b20-878e-1c324a88da68 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:39.948228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:39.949223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:39.949470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:39.949718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] PATH_INFO: `/v3/projects/710d5b0e08ff4597bf4b6d11a43a6ca2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:39.951643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710d5b0e08ff4597bf4b6d11a43a6ca2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:39.954279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.019589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710d5b0e08ff4597bf4b6d11a43a6ca2', 'request_id': 'req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:40.030228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710d5b0e08ff4597bf4b6d11a43a6ca2', 'request_id': 'req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:40.044386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710d5b0e08ff4597bf4b6d11a43a6ca2', 'request_id': 'req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:40.062187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] The token cache is being invalidate because project 710d5b0e08ff4597bf4b6d11a43a6ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:31:40.062505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:40.063298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-1f5be64e-dd86-4f8a-904d-1ad58b1654e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:40.065388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1198/2432] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:31:39 2022] DELETE /identity/v3/projects/710d5b0e08ff4597bf4b6d11a43a6ca2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:40.072189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.072597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.072963 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.097836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:40.099411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:40.156316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:40.171648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1235/2433] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:31:40.179988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.180275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.180549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.203800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:40.205108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:40.213903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1199/2434] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:40.220269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.231175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6100fa-8ab3-43fe-b2aa-e224013ba25a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.236919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.237757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.238037 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.238315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.238972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:31:40.239270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.241251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.255273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1236/2435] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:31:40.260306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.270816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26196465-d64d-4da3-b45e-8cbe7a5b410d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.276251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.276924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.277199 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.277492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.278147 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.280313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.312565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1200/2436] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:31:40.317317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.328598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68b8f9-9892-4fa8-afe6-15188bf3ba03 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.422283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.423044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.423385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.423754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.424414 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.426659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.461712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1237/2437] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/users => generated 278 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:31:40.466018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.478070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39f9b2-00b4-48ec-9504-11d7d04d57b9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.483742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.484417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.484798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.485118 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.485687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.487361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.499680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1201/2438] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:31:40.504590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.516537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0154-487c-42c3-a38a-c181631fb929 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.521581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5394e-2ee3-4f67-af74-0a42442a863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.522249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5394e-2ee3-4f67-af74-0a42442a863d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.522519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5394e-2ee3-4f67-af74-0a42442a863d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.522785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5394e-2ee3-4f67-af74-0a42442a863d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.523449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5394e-2ee3-4f67-af74-0a42442a863d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.525179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5394e-2ee3-4f67-af74-0a42442a863d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.537778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1238/2439] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:31:40.542408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.554415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88a046-c1b4-4d91-b78c-8450783a0cff admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.559559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.560260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.560554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.560881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] PATH_INFO: `/v3/projects/06d29305850c420c864a81a4e4476354/users/e6555b2843954e8f92e49bc821026a92/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.582869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d29305850c420c864a81a4e4476354, user_id=e6555b2843954e8f92e49bc821026a92, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.585805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.602831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1202/2440] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:31:40 2022] PUT /identity/v3/projects/06d29305850c420c864a81a4e4476354/users/e6555b2843954e8f92e49bc821026a92/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:40.616960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.617429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.617917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.659030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] MFA Rules not processed for user `e6555b2843954e8f92e49bc821026a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:40.662078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:40.749793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1239/2441] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:40.754835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.760978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:40.840748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1331a-b771-43b5-ae53-e1d95a3ae5fe admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.847423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.848063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.848338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.848612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.849306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.851251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:40.885050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1203/2442] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:31:40.889923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:40.901687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528131d-e771-469e-b30b-6acdbd7eaed4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:40.956311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:40.971522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:40.972190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:40.972466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:40.972775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:40.973432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:40.975449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.001124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1240/2443] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:31:40 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:31:41.006391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:41.025897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77890c2-e585-428e-a99c-ccfc85077d40 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:41.037131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:41.037131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.037131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.037131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.037925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:41.040207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.061392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1204/2444] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:31:41.066518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:41.077678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707f52-c53d-4673-8bb1-043ea818d2a0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:41.082748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:41.083435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.083710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.083981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] PATH_INFO: `/v3/projects/2d45e40ae13743c087ebdbe5b38c0610/users/8ca65e2555484b369288295f7385e74c/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.106717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d45e40ae13743c087ebdbe5b38c0610, user_id=8ca65e2555484b369288295f7385e74c, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:41.112176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.137747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1241/2445] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:31:41 2022] PUT /identity/v3/projects/2d45e40ae13743c087ebdbe5b38c0610/users/8ca65e2555484b369288295f7385e74c/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:41.143777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:41.161909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f6f7-71d7-4298-92ba-e2859af053bd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:41.269914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e668a3a-48e3-4ad2-acc5-e53a8855b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:41.270857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668a3a-48e3-4ad2-acc5-e53a8855b93a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.271345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668a3a-48e3-4ad2-acc5-e53a8855b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.271823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668a3a-48e3-4ad2-acc5-e53a8855b93a admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.273011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e668a3a-48e3-4ad2-acc5-e53a8855b93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:41.275995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e668a3a-48e3-4ad2-acc5-e53a8855b93a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.295753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1205/2446] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:31:41.301113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:41.312875 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6d8dd-3669-4778-b4bb-f70d5bf806fa admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:41.318613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:41.319350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.319665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.319983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] PATH_INFO: `/v3/projects/2d45e40ae13743c087ebdbe5b38c0610/users/8ca65e2555484b369288295f7385e74c/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.322210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d45e40ae13743c087ebdbe5b38c0610, user_id=8ca65e2555484b369288295f7385e74c, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:41.325012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.337840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1242/2447] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:31:41 2022] PUT /identity/v3/projects/2d45e40ae13743c087ebdbe5b38c0610/users/8ca65e2555484b369288295f7385e74c/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:31:41.349335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.349759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.350135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.384585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] MFA Rules not processed for user `8ca65e2555484b369288295f7385e74c`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:41.386106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:41.465872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:41.472266 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1206/2448] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:41.484603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:41.486454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:41.556695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c302a-3bd7-4716-9257-ab80a891c2fa admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:41.562536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:41.563292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.563625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.563940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.575666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:41.577932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.589703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1243/2449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:31:41.690081 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:41.701027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceb143-58ef-4769-958b-3422a4c5e980 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:41.705182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985f15-ef3a-4933-8a32-fec5b920bc1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:41.705884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985f15-ef3a-4933-8a32-fec5b920bc1e service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:41.706194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985f15-ef3a-4933-8a32-fec5b920bc1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:41.706568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985f15-ef3a-4933-8a32-fec5b920bc1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:41.777620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985f15-ef3a-4933-8a32-fec5b920bc1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:41.779211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985f15-ef3a-4933-8a32-fec5b920bc1e service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:41.793234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1207/2450] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:31:51.584461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:51.785235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=28 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:57.774943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:57.863942 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03e3c-2fef-4214-9114-57daa444f61e service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:57.869777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:57.870437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:57.870704 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:57.871329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] PATH_INFO: `/v3/users/e6555b2843954e8f92e49bc821026a92` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:57.872168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6555b2843954e8f92e49bc821026a92)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:57.874224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:57.935035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6555b2843954e8f92e49bc821026a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:57.935744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6555b2843954e8f92e49bc821026a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:57.948518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6555b2843954e8f92e49bc821026a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:57.969894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6555b2843954e8f92e49bc821026a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:57.978001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6555b2843954e8f92e49bc821026a92'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:57.986202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1244/2451] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:31:57 2022] DELETE /identity/v3/users/e6555b2843954e8f92e49bc821026a92 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:57.992776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:57.993415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:57.993723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:58.017711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:58.018983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:58.130852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1208/2452] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:58.145775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:58.147296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:58.244754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cf757-2cdc-42d5-92f5-35dba10a1c79 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:58.249457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:58.250109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:58.250386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:58.250659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:58.271082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:58.274019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:58.283519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1245/2453] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:31:58.670173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:58.674398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:58.689908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacbc7-2dd3-472e-ad3f-21d44cf3c3f4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:58.695861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:58.697483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:58.697801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:58.698125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] PATH_INFO: `/v3/projects/06d29305850c420c864a81a4e4476354` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:58.699549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d29305850c420c864a81a4e4476354)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:58.702499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:58.774205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d29305850c420c864a81a4e4476354', 'request_id': 'req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.781171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d29305850c420c864a81a4e4476354', 'request_id': 'req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.787985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d29305850c420c864a81a4e4476354', 'request_id': 'req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.817024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] The token cache is being invalidate because project 06d29305850c420c864a81a4e4476354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:31:58.817333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.818287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.820671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1209/2454] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:31:58 2022] DELETE /identity/v3/projects/06d29305850c420c864a81a4e4476354 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:58.824858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:58.838908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56f512-0884-4969-82a3-20a8f13d4b8a service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:58.860819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:58.905742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:58.906454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:58.906755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:58.907022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] PATH_INFO: `/v3/users/8ca65e2555484b369288295f7385e74c` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:58.908231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca65e2555484b369288295f7385e74c)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:58.910224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:58.971181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca65e2555484b369288295f7385e74c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.971903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca65e2555484b369288295f7385e74c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:58.992261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca65e2555484b369288295f7385e74c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.006964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca65e2555484b369288295f7385e74c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.013956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-010b0e44-49dc-4dfc-9d51-eebf979ca5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca65e2555484b369288295f7385e74c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.020512 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1246/2455] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:31:58 2022] DELETE /identity/v3/users/8ca65e2555484b369288295f7385e74c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:31:59.341109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:59.344802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:59.368024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a227e-7ff4-408c-b78f-9cb02a9a6146 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:59.447790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:59.448435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.448747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.449019 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] PATH_INFO: `/v3/projects/2d45e40ae13743c087ebdbe5b38c0610` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.450205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d45e40ae13743c087ebdbe5b38c0610)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:59.452284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:59.493365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:59.519326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d45e40ae13743c087ebdbe5b38c0610', 'request_id': 'req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.526527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d45e40ae13743c087ebdbe5b38c0610', 'request_id': 'req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.534583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d45e40ae13743c087ebdbe5b38c0610', 'request_id': 'req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.551892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] The token cache is being invalidate because project 2d45e40ae13743c087ebdbe5b38c0610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:31:59.552187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.552907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8c1f1a6b-3bef-407c-bde0-fa319a4850dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:31:59.554707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1210/2456] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:31:59 2022] DELETE /identity/v3/projects/2d45e40ae13743c087ebdbe5b38c0610 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:31:59.561550 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.562028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.562735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.598607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:59.599898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:59.668639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1247/2457] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:59.677275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.677558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.677828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.698578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:31:59.699786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:31:59.707871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1211/2458] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:31:59.721047 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:59.731324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8082d-5776-4fd3-93b9-2963ab51473f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:59.737284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:59.737947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.738260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.738615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.739443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:31:59.739944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:59.743000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:59.757633 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1248/2459] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:31:59.763349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:59.776090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d92ab6-b0e1-4dca-95d7-99d8add7b8d1 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:59.781661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:59.782346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.782810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.783337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.784331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:59.786571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:59.822992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1212/2460] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:31:59 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:31:59.827391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:59.838422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d617e-a2c2-4d96-948d-c37a0d2bf336 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:59.871187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:59.913741 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:59.914175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.914615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.915041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.915867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:59.924388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:59.957507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1249/2461] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:31:59 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:31:59.959259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:31:59.971665 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c9e33-62c2-421c-8c95-a8df8d1eff3b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:31:59.977267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:31:59.978581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:31:59.978581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:31:59.978581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:31:59.979078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:31:59.980752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:31:59.999599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1213/2462] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:00.003998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.017489 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aab6b4-2ba4-49c7-a785-8db2733e1149 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.022919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43780-c0cd-4516-9d86-8f4845fb946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.023602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43780-c0cd-4516-9d86-8f4845fb946c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.023899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43780-c0cd-4516-9d86-8f4845fb946c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.024331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43780-c0cd-4516-9d86-8f4845fb946c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.025028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43780-c0cd-4516-9d86-8f4845fb946c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.026724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43780-c0cd-4516-9d86-8f4845fb946c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.051102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1250/2463] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:00.055321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.069553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a472ad-4d93-42e3-9f21-d47dc949ae87 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.075438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.076207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.076482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.076900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] PATH_INFO: `/v3/projects/78431af370444c11b40ae380c2070b71/users/a80ed8159f3341049e9d8f0fa0c07946/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.094355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=78431af370444c11b40ae380c2070b71, user_id=a80ed8159f3341049e9d8f0fa0c07946, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.097208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.118499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1214/2464] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:00 2022] PUT /identity/v3/projects/78431af370444c11b40ae380c2070b71/users/a80ed8159f3341049e9d8f0fa0c07946/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:00.133859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.134272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.134652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.167984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] MFA Rules not processed for user `a80ed8159f3341049e9d8f0fa0c07946`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:00.169309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:00.270797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1251/2465] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:00.276654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.365512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07055b5-db6f-4ccc-96be-d2e1310909bd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.371650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.372282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.372565 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.372883 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.373775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.375802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.437574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1215/2466] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:00 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:00.439995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.459833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e158c-61bb-41e4-8505-c95d54f17f2b None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.550683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.551295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.551490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.551746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.552582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.554621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.591747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1252/2467] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:00 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:00.597491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.617328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784df89-6bfd-4250-8d83-1a43d2084a8b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.624086 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.625115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.625609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.625898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.626574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.628355 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.645186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1216/2468] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:00.649340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.664359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5c659-c17e-438c-95a9-501ae5457533 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.669710 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.670415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.670694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.671119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] PATH_INFO: `/v3/projects/583c269696e940cc91c13b683bd1b909/users/df696f2c1c784a5086e3a5c605a143ca/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.688892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583c269696e940cc91c13b683bd1b909, user_id=df696f2c1c784a5086e3a5c605a143ca, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.691486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.706911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1253/2469] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:00 2022] PUT /identity/v3/projects/583c269696e940cc91c13b683bd1b909/users/df696f2c1c784a5086e3a5c605a143ca/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:00.711184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.721983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e35059-5b95-4383-bf6a-b226e494bab1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.746337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:00.794839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42fea-1e32-4071-a0ff-b0aec79f333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.795515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42fea-1e32-4071-a0ff-b0aec79f333d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.795800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42fea-1e32-4071-a0ff-b0aec79f333d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.796072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42fea-1e32-4071-a0ff-b0aec79f333d admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.796753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42fea-1e32-4071-a0ff-b0aec79f333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.798411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42fea-1e32-4071-a0ff-b0aec79f333d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.812764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1217/2470] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:00.817303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:00.825240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:00.834326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561b843-c6f6-4e4b-afc2-e6d3304006d8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:00.843026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:00.844189 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.844688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.845138 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] PATH_INFO: `/v3/projects/583c269696e940cc91c13b683bd1b909/users/df696f2c1c784a5086e3a5c605a143ca/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.848720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583c269696e940cc91c13b683bd1b909, user_id=df696f2c1c784a5086e3a5c605a143ca, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:00.853816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:00.874181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1254/2471] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:00 2022] PUT /identity/v3/projects/583c269696e940cc91c13b683bd1b909/users/df696f2c1c784a5086e3a5c605a143ca/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:00.885501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578069-309d-45d3-859b-bab40cabf530 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:00.885839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578069-309d-45d3-859b-bab40cabf530 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:00.886112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578069-309d-45d3-859b-bab40cabf530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:00.916003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-df578069-309d-45d3-859b-bab40cabf530 None None] MFA Rules not processed for user `df696f2c1c784a5086e3a5c605a143ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:00.917261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-df578069-309d-45d3-859b-bab40cabf530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:00.994975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1218/2472] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:01.009051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:01.011045 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:01.077469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127004-98a8-46c0-b81a-f9bbeef5cb79 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:01.082449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:01.083079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:01.083355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:01.083624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:01.095400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:01.097106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:01.107713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1255/2473] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:01.199097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578069-309d-45d3-859b-bab40cabf530 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:01.210472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578069-309d-45d3-859b-bab40cabf530 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:01.214221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f66978-359a-4351-9216-e67493ae4ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:01.214935 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f66978-359a-4351-9216-e67493ae4ebd service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:01.215218 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f66978-359a-4351-9216-e67493ae4ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:01.215491 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f66978-359a-4351-9216-e67493ae4ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:01.284490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f66978-359a-4351-9216-e67493ae4ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:01.285684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f66978-359a-4351-9216-e67493ae4ebd service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:01.295593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1219/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:08.867893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:08.942367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd35d-2649-45f8-b165-e02c10c3da5c service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:08.950484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:08.951180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:08.951491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:08.951767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] PATH_INFO: `/v3/users/a80ed8159f3341049e9d8f0fa0c07946` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:08.952991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80ed8159f3341049e9d8f0fa0c07946)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:08.955163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:09.013535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80ed8159f3341049e9d8f0fa0c07946'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.014252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80ed8159f3341049e9d8f0fa0c07946'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.023955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80ed8159f3341049e9d8f0fa0c07946'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.048513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80ed8159f3341049e9d8f0fa0c07946'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.057505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80ed8159f3341049e9d8f0fa0c07946'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.065839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1256/2475] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:08 2022] DELETE /identity/v3/users/a80ed8159f3341049e9d8f0fa0c07946 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:09.070539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:09.071088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:09.071088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:09.093738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:09.095839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:09.155155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:09.187213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1220/2476] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:09.199940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:09.201785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:09.222690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:09.274541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567e4d5-0e89-4fa9-8102-b995ebb371d3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:09.278617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:09.279221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:09.279488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:09.279717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:09.289660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:09.291086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:09.303243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1257/2477] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:09.649885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:09.651392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:09.670436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32647490-8b8e-48d0-895e-9d6265819584 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:09.678100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:09.679128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:09.679475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:09.679928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] PATH_INFO: `/v3/projects/78431af370444c11b40ae380c2070b71` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:09.681337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78431af370444c11b40ae380c2070b71)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:09.683758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:09.750989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78431af370444c11b40ae380c2070b71', 'request_id': 'req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.757362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78431af370444c11b40ae380c2070b71', 'request_id': 'req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.765101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78431af370444c11b40ae380c2070b71', 'request_id': 'req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.785386 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] The token cache is being invalidate because project 78431af370444c11b40ae380c2070b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:09.785988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.787123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.789877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1221/2478] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:09 2022] DELETE /identity/v3/projects/78431af370444c11b40ae380c2070b71 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:09.795607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:09.810634 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb954a-0b06-4ff9-90c6-d0a655a5481b service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:09.872347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:09.873129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:09.873271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:09.873545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] PATH_INFO: `/v3/users/df696f2c1c784a5086e3a5c605a143ca` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:09.874696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df696f2c1c784a5086e3a5c605a143ca)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:09.876792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:09.931621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df696f2c1c784a5086e3a5c605a143ca'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.932269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df696f2c1c784a5086e3a5c605a143ca'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.943610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df696f2c1c784a5086e3a5c605a143ca'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.960165 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df696f2c1c784a5086e3a5c605a143ca'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.970462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-992e1c2d-2e42-41ff-a948-f41f4b8ecc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df696f2c1c784a5086e3a5c605a143ca'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:09.980199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1258/2479] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:09 2022] DELETE /identity/v3/users/df696f2c1c784a5086e3a5c605a143ca => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:10.351912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:10.354127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:10.369953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc9f1-3671-4b2b-b02c-568e7096d0e5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:10.452691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:10.453476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.454504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.454783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] PATH_INFO: `/v3/projects/583c269696e940cc91c13b683bd1b909` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.456050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583c269696e940cc91c13b683bd1b909)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:10.458062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:10.510952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583c269696e940cc91c13b683bd1b909', 'request_id': 'req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:10.517116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583c269696e940cc91c13b683bd1b909', 'request_id': 'req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:10.524636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583c269696e940cc91c13b683bd1b909', 'request_id': 'req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:10.540560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:10.546678 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] The token cache is being invalidate because project 583c269696e940cc91c13b683bd1b909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:10.547177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:10.548889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-babfafb8-74ea-4d2e-b454-fb8ebc19ec70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:10.551088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1222/2480] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:10 2022] DELETE /identity/v3/projects/583c269696e940cc91c13b683bd1b909 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:10.557328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.557604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.558372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.580196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:10.581474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:10.613887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:10.650020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1259/2481] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:10.659324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.659601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.660007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.682808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:10.684107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:10.694006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1223/2482] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:10.698554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:10.711212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75f56-e292-4a22-9f3b-3144905e60db None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:10.715938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:10.716556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.716857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.717123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.717778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:10.718073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:10.719728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:10.732248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1260/2483] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:32:10.737658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:10.749273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b55fb-4c66-4793-a60a-e077d47d9d5f None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:10.754908 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:10.755588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.755813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.756083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.756757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:10.758683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:10.791430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1224/2484] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:10 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:10.797421 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:10.808406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c99d0-6fc5-4d52-ae66-846ba6604a53 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:10.872831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:10.873537 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.873665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.874430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.874618 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:10.876958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:10.902087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1261/2485] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:10 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:10.914361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:10.927685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639935-1757-4f3d-ba0e-f51dcee895ad admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:10.933411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:10.934141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.934308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.934609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.935231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:10.936973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:10.960930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1225/2486] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:10.964242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:10.975784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc936-898d-40a7-884b-25baee4f7d55 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:10.981177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92967d9-4e00-4f5e-b5c4-237aae76f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:10.981819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92967d9-4e00-4f5e-b5c4-237aae76f563 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:10.982095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92967d9-4e00-4f5e-b5c4-237aae76f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:10.982364 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92967d9-4e00-4f5e-b5c4-237aae76f563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:10.983023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92967d9-4e00-4f5e-b5c4-237aae76f563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:10.984712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92967d9-4e00-4f5e-b5c4-237aae76f563 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:10.997243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1262/2487] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:11.002468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.014644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb1232-babf-4f38-b090-c422416c646e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.023004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.024123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.024475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.025029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] PATH_INFO: `/v3/projects/362e56d0a68e447aba86ab0863f15db9/users/8df83cebb90a4689a71d956ceb74b4ee/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.052576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362e56d0a68e447aba86ab0863f15db9, user_id=8df83cebb90a4689a71d956ceb74b4ee, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.055531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.074189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1226/2488] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:11 2022] PUT /identity/v3/projects/362e56d0a68e447aba86ab0863f15db9/users/8df83cebb90a4689a71d956ceb74b4ee/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:11.086128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.086352 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.086559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.124449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] MFA Rules not processed for user `8df83cebb90a4689a71d956ceb74b4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:11.125828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:11.197788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1263/2489] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:11.203453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.270589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ddd1-bcd3-4643-bb2a-84c36c4a7ce1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.276907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.277538 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.277811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.278080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.278728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.280778 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.324746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1227/2490] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:11 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:11.332171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.351374 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aee8f-fa12-40bd-8795-4ddc9ce92600 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.399794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:11.442025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.442672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.442981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.443256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.443968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.445915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.469297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1264/2491] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:11 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:11.473650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.485570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ef262-b5a6-4ef6-8784-77b76e018567 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.491022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.491995 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.492278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.492550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.493241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.494878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.507286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1228/2492] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:11.511601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.522600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0476e-f005-429c-b73b-008d72889bdb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.527539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4069af8-31bd-436f-a74d-83954b3e5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.528160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4069af8-31bd-436f-a74d-83954b3e5887 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.528432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4069af8-31bd-436f-a74d-83954b3e5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.528733 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4069af8-31bd-436f-a74d-83954b3e5887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.529380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4069af8-31bd-436f-a74d-83954b3e5887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.531001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4069af8-31bd-436f-a74d-83954b3e5887 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.542125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1265/2493] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:11.546436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.556777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daf50b-fa50-4725-85e8-da953085a7d0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.561653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.562325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.562717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.563134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] PATH_INFO: `/v3/projects/2ed9ce3801c249b18c145f8058c3f6ae/users/cdbfe05b42354268b207d95619e424ea/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.579970 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed9ce3801c249b18c145f8058c3f6ae, user_id=cdbfe05b42354268b207d95619e424ea, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.582691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.598997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1229/2494] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:11 2022] PUT /identity/v3/projects/2ed9ce3801c249b18c145f8058c3f6ae/users/cdbfe05b42354268b207d95619e424ea/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:11.610299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.610701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.611075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.643836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] MFA Rules not processed for user `cdbfe05b42354268b207d95619e424ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:11.645300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:11.719860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1266/2495] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:11.725085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.783366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:11.801717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8ebc0-aff7-4e2f-8e80-d1d4513d5313 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.807090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.807712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.807987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.808234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.808899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.810809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.843402 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1230/2496] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:11 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:11.848256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.861485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf205e3-d0c5-457b-859e-e64f2e0dc261 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.923366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.924402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.924402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.924756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.925183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.927152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:11.951429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1267/2497] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:11 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:11.956205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:11.973812 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68ce11-a241-4d03-87e3-50e51adcc101 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:11.986375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:11.987029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:11.987302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:11.987571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:11.988288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:11.989978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:12.002354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1231/2498] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:12.007171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:12.018495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdeec-f109-49fd-80b7-da9461b28f48 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:12.023466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:12.024150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:12.024425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:12.024736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] PATH_INFO: `/v3/projects/93f48fcc20254a8297cacf3361cb61be/users/c5b51fb9a7b94cea991e908f1a28cf23/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:12.042891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f48fcc20254a8297cacf3361cb61be, user_id=c5b51fb9a7b94cea991e908f1a28cf23, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:12.045878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:12.061879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1268/2499] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:12 2022] PUT /identity/v3/projects/93f48fcc20254a8297cacf3361cb61be/users/c5b51fb9a7b94cea991e908f1a28cf23/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:12.066338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:12.077056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ffcdf-c61b-4619-8652-aa172df6e4ba admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:12.146332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066baa37-df59-4892-9fc8-0a1242c68f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:12.146888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066baa37-df59-4892-9fc8-0a1242c68f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:12.147146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066baa37-df59-4892-9fc8-0a1242c68f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:12.147503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066baa37-df59-4892-9fc8-0a1242c68f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:12.148159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066baa37-df59-4892-9fc8-0a1242c68f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:12.149851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066baa37-df59-4892-9fc8-0a1242c68f4c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:12.162816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1232/2500] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:12.167388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:12.176895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:12.183155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd535a-dcab-43fc-86e5-2c808b798167 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:12.190681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:12.191780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:12.191780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:12.192014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] PATH_INFO: `/v3/projects/93f48fcc20254a8297cacf3361cb61be/users/c5b51fb9a7b94cea991e908f1a28cf23/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:12.193844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f48fcc20254a8297cacf3361cb61be, user_id=c5b51fb9a7b94cea991e908f1a28cf23, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:12.196657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:12.212888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1269/2501] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:12 2022] PUT /identity/v3/projects/93f48fcc20254a8297cacf3361cb61be/users/c5b51fb9a7b94cea991e908f1a28cf23/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:12.219807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:12.220087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:12.220357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:12.256116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] MFA Rules not processed for user `c5b51fb9a7b94cea991e908f1a28cf23`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:12.257426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:12.356951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1233/2502] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:12.374727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:12.377313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:12.451536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8477fc2-f58e-4109-a9cb-631416ecc276 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:12.455944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:12.456576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:12.456973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:12.457236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:12.468123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:12.470615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:12.481698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1270/2503] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:13.100145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:13.101692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:13.122672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5f037-8049-45eb-896f-1ae16680a2f9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:13.127498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:13.128136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:13.128422 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:13.128723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:13.175994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:13.199832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:13.201253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:13.211951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1234/2504] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:13.558498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:13.560509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:13.632842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a044f30-e349-4bf6-83e0-b817aa8e9c75 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:13.638176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:13.638872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:13.639215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:13.639488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:13.642371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:13.723968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:13.725703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:13.739842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1271/2505] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:17.408722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:17.415353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:17.443680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4b792-68c3-45ca-8b76-3f1968152ce9 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:17.448544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:17.449243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:17.449517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:17.449788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] PATH_INFO: `/v3/users/8c8ad3919d764781a90420e48c65df2c` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:17.451196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8ad3919d764781a90420e48c65df2c)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:17.453306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:17.516677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8ad3919d764781a90420e48c65df2c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:17.530553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8ad3919d764781a90420e48c65df2c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:17.531217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8ad3919d764781a90420e48c65df2c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:17.547779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8ad3919d764781a90420e48c65df2c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:17.557335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8ad3919d764781a90420e48c65df2c'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:17.564946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1235/2506] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:17 2022] DELETE /identity/v3/users/8c8ad3919d764781a90420e48c65df2c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:17.678508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:17.689722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40636b-5be8-4bad-9e61-586f77a1fc83 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:17.744079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:17.759978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:17.760614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:17.760917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:17.761182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:17.763091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:17.798599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:17.801492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:17.868911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:17.870306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791007b-93b1-4575-bbba-7dc063152957 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:17.883585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1272/2507] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:17.909631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd73d5-8c72-487f-b215-8acf06c3ba95 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:17.916597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:17.925104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:17.925104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:17.925104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] PATH_INFO: `/v3/projects/3d706052c3924cf88b9ea5b24b26403b` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:17.925104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d706052c3924cf88b9ea5b24b26403b)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:17.925104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:17.998539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d706052c3924cf88b9ea5b24b26403b', 'request_id': 'req-c96f4e6e-d680-46c3-b266-52646e7ef167'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:18.002360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:18.010033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d706052c3924cf88b9ea5b24b26403b', 'request_id': 'req-c96f4e6e-d680-46c3-b266-52646e7ef167'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:18.023766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d706052c3924cf88b9ea5b24b26403b', 'request_id': 'req-c96f4e6e-d680-46c3-b266-52646e7ef167'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:18.056080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] The token cache is being invalidate because project 3d706052c3924cf88b9ea5b24b26403b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:18.056377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:18.057672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c96f4e6e-d680-46c3-b266-52646e7ef167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:18.060561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1236/2508] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:17 2022] DELETE /identity/v3/projects/3d706052c3924cf88b9ea5b24b26403b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:18.066805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.067292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.067747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.098178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:18.099903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:18.210856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1273/2509] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:18.219960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.220341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.220858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.249102 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:18.251025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:18.263458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1237/2510] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:18.268742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.280888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c012cf7-3b64-4e5e-a291-152b84d075d8 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.287082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.287807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.288086 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.288505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.289308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:18.289736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:18.291601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:18.312916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1274/2511] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:18.315468 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.328298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5a14-5f8e-4a3c-9642-0ef477fa1b8e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.335114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.335959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.336344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.336763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.337471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:18.339524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:18.378753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1238/2512] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:18 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:18.385023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.397956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b677fb-d560-4f48-9a66-0d2bc0dca3b7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.515720 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.517180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.517753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.518332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.519580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:18.523822 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:18.559497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1275/2513] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:18 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:18.560890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.572675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6fa42-01fb-4181-9a73-2deeadd78372 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.577701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.578536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.578809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.579078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.579735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:18.581399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:18.594687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1239/2514] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:18.600381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.619708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02bd4f-f632-42f9-9e9f-32e70597cc72 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.628244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643748e5-517d-47e9-a250-9a1bea39095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.629347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643748e5-517d-47e9-a250-9a1bea39095a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.629804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643748e5-517d-47e9-a250-9a1bea39095a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.630295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643748e5-517d-47e9-a250-9a1bea39095a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.631528 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643748e5-517d-47e9-a250-9a1bea39095a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:18.634628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643748e5-517d-47e9-a250-9a1bea39095a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:18.654177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1276/2515] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:18.658600 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.670914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c02e8-dd1d-43a2-bfb5-ad90420569c9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.676395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.677139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.677404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.677707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] PATH_INFO: `/v3/projects/25b3d3523326499dab42d77d2885846a/users/98782a5506f54bfb849c276af58efcab/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.697546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b3d3523326499dab42d77d2885846a, user_id=98782a5506f54bfb849c276af58efcab, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:18.702686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:18.730441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1240/2516] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:18 2022] PUT /identity/v3/projects/25b3d3523326499dab42d77d2885846a/users/98782a5506f54bfb849c276af58efcab/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:18.736387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e94d5-3878-4a03-bc11-b2ef49ab715e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.737004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e94d5-3878-4a03-bc11-b2ef49ab715e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.737004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e94d5-3878-4a03-bc11-b2ef49ab715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:18.748881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:18.771534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-8a7e94d5-3878-4a03-bc11-b2ef49ab715e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:18.773699 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8a7e94d5-3878-4a03-bc11-b2ef49ab715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:18.865693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1277/2517] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:18.878760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:18.880806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:18.975085 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d574fc-feb0-468b-a37d-147ecb1c7ea7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:18.981335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:18.982372 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:18.982832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:18.983360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:19.000939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:19.003816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:19.021497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1241/2518] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:19.774337 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:19.774985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:19.774985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:19.810605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] MFA Rules not processed for user `98782a5506f54bfb849c276af58efcab`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:19.812114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:19.918860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1278/2519] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:19.924759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:19.935253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d2565-1e2d-4152-8037-97f9733ea4fb service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:19.942560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:19.943598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:19.944106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:19.944576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:19.945474 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:19.947666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:19.983954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1242/2520] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:19 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:19.990067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.017536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae46d7-882b-4932-8e27-503707635a37 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:20.100330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:20.100977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.101247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.101654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.102318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:20.104834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:20.134164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1279/2521] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:19 2022] POST /identity/v3/users => generated 308 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:20.138246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.150239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91d8e3-c957-4993-b1f0-38b4b3637889 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:20.157965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:20.158722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.159404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.159738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.160667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:20.166122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:20.178561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1243/2522] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:20.183567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.195105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66305b-79cb-44aa-b9fe-36df65cf00b9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:20.201263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:20.201980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.202224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.202497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] PATH_INFO: `/v3/projects/1d4e3d8814614cdaba7637f81dc807e9/users/80c7ad977a3f4f55bef0de31a94e5554/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.222116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4e3d8814614cdaba7637f81dc807e9, user_id=80c7ad977a3f4f55bef0de31a94e5554, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:20.224908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:20.238176 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:20.244353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1280/2523] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:20 2022] PUT /identity/v3/projects/1d4e3d8814614cdaba7637f81dc807e9/users/80c7ad977a3f4f55bef0de31a94e5554/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:20.248802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.260734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022bc0a-245a-4898-ba3d-12ed6078ad34 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:20.313585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:20.329162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:20.329799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.330077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.330349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.330998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:20.332614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:20.347036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1244/2524] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:20.351792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.363234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0c68-837e-448a-811a-5d0b7b4d34e4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:20.369608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7072-a6d6-4118-85d6-37022ea4e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:20.370296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7072-a6d6-4118-85d6-37022ea4e1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.370566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7072-a6d6-4118-85d6-37022ea4e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.370835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7072-a6d6-4118-85d6-37022ea4e1e0 admin admin] PATH_INFO: `/v3/projects/1d4e3d8814614cdaba7637f81dc807e9/users/80c7ad977a3f4f55bef0de31a94e5554/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.373162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de7072-a6d6-4118-85d6-37022ea4e1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4e3d8814614cdaba7637f81dc807e9, user_id=80c7ad977a3f4f55bef0de31a94e5554, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:20.376244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de7072-a6d6-4118-85d6-37022ea4e1e0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:20.388588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1281/2525] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:20 2022] PUT /identity/v3/projects/1d4e3d8814614cdaba7637f81dc807e9/users/80c7ad977a3f4f55bef0de31a94e5554/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:20.529959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.532055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:20.551123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5347b-b8c7-49c8-8882-53a9714ee0b5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:20.647738 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:20.648403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.648742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.649006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] PATH_INFO: `/v3/users/8df83cebb90a4689a71d956ceb74b4ee` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.650515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df83cebb90a4689a71d956ceb74b4ee)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:20.652939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:20.713945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df83cebb90a4689a71d956ceb74b4ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:20.726285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df83cebb90a4689a71d956ceb74b4ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:20.726285 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df83cebb90a4689a71d956ceb74b4ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:20.749952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df83cebb90a4689a71d956ceb74b4ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:20.766253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df83cebb90a4689a71d956ceb74b4ee'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:20.783992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1245/2526] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:20 2022] DELETE /identity/v3/users/8df83cebb90a4689a71d956ceb74b4ee => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:20.786287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e721e-52f7-4f09-b600-bed27df16288 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:20.786783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e721e-52f7-4f09-b600-bed27df16288 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:20.787152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e721e-52f7-4f09-b600-bed27df16288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:20.810832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5e2e721e-52f7-4f09-b600-bed27df16288 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:20.812089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5e2e721e-52f7-4f09-b600-bed27df16288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:20.937984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1282/2527] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:20.950627 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:20.953504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:21.027653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa2798-5ad5-4bb3-bf8b-a535af683a98 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:21.031846 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:21.033301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:21.033763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:21.034196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:21.051061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:21.052562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:21.067842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1246/2528] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:21.304569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:21.305423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:21.306000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:21.343417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] MFA Rules not processed for user `80c7ad977a3f4f55bef0de31a94e5554`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:21.345253 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:21.464349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1283/2529] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:21.655761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:21.657598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:21.667533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:21.673059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c736-8989-4f00-b40d-1c0332979b95 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:21.682711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:21.684138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:21.684502 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:21.685349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] PATH_INFO: `/v3/projects/362e56d0a68e447aba86ab0863f15db9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:21.687095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362e56d0a68e447aba86ab0863f15db9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:21.689829 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:21.775591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362e56d0a68e447aba86ab0863f15db9', 'request_id': 'req-9800342b-ba00-4ff2-951b-aaf9e363cfa9'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:21.786489 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362e56d0a68e447aba86ab0863f15db9', 'request_id': 'req-9800342b-ba00-4ff2-951b-aaf9e363cfa9'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:21.799049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362e56d0a68e447aba86ab0863f15db9', 'request_id': 'req-9800342b-ba00-4ff2-951b-aaf9e363cfa9'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:21.822942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] The token cache is being invalidate because project 362e56d0a68e447aba86ab0863f15db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:21.823248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:21.823971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:21.825811 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1247/2530] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:21 2022] DELETE /identity/v3/projects/362e56d0a68e447aba86ab0863f15db9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:21.830698 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:21.843122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455597-9e98-4174-8766-c40f07d42fdd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:21.918269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:21.919333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:21.919932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:21.920545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] PATH_INFO: `/v3/users/cdbfe05b42354268b207d95619e424ea` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:21.922525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdbfe05b42354268b207d95619e424ea)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:21.924811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:21.941214 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:21.999669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdbfe05b42354268b207d95619e424ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.000832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdbfe05b42354268b207d95619e424ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.011003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdbfe05b42354268b207d95619e424ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.033783 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdbfe05b42354268b207d95619e424ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.045477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdbfe05b42354268b207d95619e424ea'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.052894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1284/2531] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:21 2022] DELETE /identity/v3/users/cdbfe05b42354268b207d95619e424ea => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:22.439728 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:22.441456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:22.462463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800342b-ba00-4ff2-951b-aaf9e363cfa9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:22.540477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:22.541404 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:22.541929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:22.542282 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] PATH_INFO: `/v3/projects/2ed9ce3801c249b18c145f8058c3f6ae` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:22.543885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed9ce3801c249b18c145f8058c3f6ae)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:22.546112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:22.626884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed9ce3801c249b18c145f8058c3f6ae', 'request_id': 'req-639b01af-ea51-4b27-ab50-0e3b5e8d1635'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.634106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed9ce3801c249b18c145f8058c3f6ae', 'request_id': 'req-639b01af-ea51-4b27-ab50-0e3b5e8d1635'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.642634 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed9ce3801c249b18c145f8058c3f6ae', 'request_id': 'req-639b01af-ea51-4b27-ab50-0e3b5e8d1635'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.665188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] The token cache is being invalidate because project 2ed9ce3801c249b18c145f8058c3f6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:22.665685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.666776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.670124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1248/2532] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:22 2022] DELETE /identity/v3/projects/2ed9ce3801c249b18c145f8058c3f6ae => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:22.674744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:22.676202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:22.689925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f836-a008-4ba5-b98d-2054b96b5521 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:22.784828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:22.785637 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:22.786116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:22.786599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] PATH_INFO: `/v3/users/c5b51fb9a7b94cea991e908f1a28cf23` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:22.788845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b51fb9a7b94cea991e908f1a28cf23)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:22.793606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:22.910249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b51fb9a7b94cea991e908f1a28cf23'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.912080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b51fb9a7b94cea991e908f1a28cf23'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.934925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b51fb9a7b94cea991e908f1a28cf23'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.955558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b51fb9a7b94cea991e908f1a28cf23'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.965824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b51fb9a7b94cea991e908f1a28cf23'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:22.975462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1285/2533] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:22 2022] DELETE /identity/v3/users/c5b51fb9a7b94cea991e908f1a28cf23 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:23.566718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:23.570601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:23.595867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b01af-ea51-4b27-ab50-0e3b5e8d1635 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:23.621421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:23.681546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:23.682356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:23.682736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:23.683107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] PATH_INFO: `/v3/users/98782a5506f54bfb849c276af58efcab` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:23.684490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98782a5506f54bfb849c276af58efcab)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:23.686732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:23.694282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:23.696924 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:23.721927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb048-bdcd-4930-a5c0-21d38f5d4957 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:23.728811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:23.729612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:23.729948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:23.730226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] PATH_INFO: `/v3/projects/93f48fcc20254a8297cacf3361cb61be` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:23.731960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f48fcc20254a8297cacf3361cb61be)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:23.734391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:23.738209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:23.770423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98782a5506f54bfb849c276af58efcab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.787097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98782a5506f54bfb849c276af58efcab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.787754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98782a5506f54bfb849c276af58efcab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.803910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98782a5506f54bfb849c276af58efcab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.815941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-815af991-f42e-4d54-ac81-b93ad39fd275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98782a5506f54bfb849c276af58efcab'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.822988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1249/2534] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:23 2022] DELETE /identity/v3/users/98782a5506f54bfb849c276af58efcab => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:23.842820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f48fcc20254a8297cacf3361cb61be', 'request_id': 'req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.852647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f48fcc20254a8297cacf3361cb61be', 'request_id': 'req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.863545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f48fcc20254a8297cacf3361cb61be', 'request_id': 'req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.879729 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] The token cache is being invalidate because project 93f48fcc20254a8297cacf3361cb61be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:23.880188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.881092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-91b247c7-7bcd-4512-8c85-c9fbc49f59c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:23.883798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1286/2535] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:23 2022] DELETE /identity/v3/projects/93f48fcc20254a8297cacf3361cb61be => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:23.889820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:23.890163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:23.890611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:23.918234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:23.924219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.020917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1250/2536] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:24.029723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.030956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.031928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.063526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:24.065011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.073823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1287/2537] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:24.078794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.089108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e630b11-8e0b-45f7-afba-6c2554e537ea None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.095122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.095122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.095469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.095607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.096301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:24.096597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.098268 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.117091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1251/2538] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:24.122643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.136529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e57886-a4cf-4d9e-8501-ec6063acb31c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.142204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.143215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.144286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.144756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.145058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.145547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.146372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.149345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.175196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93b4f-8953-4671-a384-a3cc2c7419cc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.184511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.185700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.186214 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.187702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] PATH_INFO: `/v3/projects/25b3d3523326499dab42d77d2885846a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.191008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b3d3523326499dab42d77d2885846a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.196139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.199782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1288/2539] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:24 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:24.206666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.261897 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:24.332143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b3d3523326499dab42d77d2885846a', 'request_id': 'req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.363103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b3d3523326499dab42d77d2885846a', 'request_id': 'req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.378139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b3d3523326499dab42d77d2885846a', 'request_id': 'req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.394092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837638-526f-4e75-a7bd-b188de566b20 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.398614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] The token cache is being invalidate because project 25b3d3523326499dab42d77d2885846a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:24.399225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.400607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.404680 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1252/2540] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:24 2022] DELETE /identity/v3/projects/25b3d3523326499dab42d77d2885846a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:24.407858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.410465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.502806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.504002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.504386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.504658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.505420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.507736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.530241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:24.531040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c2f9-8ba3-4b0c-ba3e-b568cabaa687 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.537668 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1289/2541] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:24 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:24.539663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.540584 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.540980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.541333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] PATH_INFO: `/v3/users/80c7ad977a3f4f55bef0de31a94e5554` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.543715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.548882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c7ad977a3f4f55bef0de31a94e5554)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.549903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.552137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.568474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94326-35a9-4468-bbb1-ba9f0e3e3fec admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.577829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.579056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.579664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.580250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.582208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.586599 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.606407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1290/2542] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:24.611756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.629415 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff275-8174-4fdd-9ce8-ddbcd782b2cb admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.638029 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.638758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.639108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.639456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.640243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.642005 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.655733 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c7ad977a3f4f55bef0de31a94e5554'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.659442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1291/2543] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:24.666125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.680901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c7ad977a3f4f55bef0de31a94e5554'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.682817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99fb95-d615-44d4-b6af-7dac4ec82084 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:24.683121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c7ad977a3f4f55bef0de31a94e5554'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.688932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:24.689750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.690033 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.690385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] PATH_INFO: `/v3/projects/c0567cfb0b88486ca874db122fa3f886/users/fccb669827844b029013472dbe51c0e3/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.710842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0567cfb0b88486ca874db122fa3f886, user_id=fccb669827844b029013472dbe51c0e3, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:24.714018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:24.714572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c7ad977a3f4f55bef0de31a94e5554'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.733297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-01b79be7-30b7-42df-8b32-d904d5c6f4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c7ad977a3f4f55bef0de31a94e5554'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:24.740362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1253/2544] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:24 2022] DELETE /identity/v3/users/80c7ad977a3f4f55bef0de31a94e5554 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:24.743223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1292/2545] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:24 2022] PUT /identity/v3/projects/c0567cfb0b88486ca874db122fa3f886/users/fccb669827844b029013472dbe51c0e3/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:24.764805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:24.765258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:24.765562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:24.798632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] MFA Rules not processed for user `fccb669827844b029013472dbe51c0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:24.799755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.827887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:24.898765 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1254/2546] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:24.903036 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.905246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:24.975626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:24.977994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:25.067021 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062c0e0-625c-4e62-9e9b-c4f403df15f0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.128762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4113684-5baa-4cf9-8776-582ba222507a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.142555 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.144076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.144462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.144863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] PATH_INFO: `/v3/projects/1d4e3d8814614cdaba7637f81dc807e9` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.148964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4e3d8814614cdaba7637f81dc807e9)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.155783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.207505 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.207842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.207985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.208158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.208888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.210901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.254938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4e3d8814614cdaba7637f81dc807e9', 'request_id': 'req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:25.256688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1293/2547] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:24 2022] POST /identity/v3/projects => generated 379 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:25.259706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.263714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4e3d8814614cdaba7637f81dc807e9', 'request_id': 'req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:25.273517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4e3d8814614cdaba7637f81dc807e9', 'request_id': 'req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:25.298392 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] The token cache is being invalidate because project 1d4e3d8814614cdaba7637f81dc807e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:25.298967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:25.300063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c3bc5181-127c-4c4c-a5ff-d6ccc453dc84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:25.302802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1255/2548] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:24 2022] DELETE /identity/v3/projects/1d4e3d8814614cdaba7637f81dc807e9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:25.310077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e9cf-e2ef-4ee9-a9ca-7887a29157a0 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.310579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e9cf-e2ef-4ee9-a9ca-7887a29157a0 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.311039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e9cf-e2ef-4ee9-a9ca-7887a29157a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.327400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:25.342718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c426e9cf-e2ef-4ee9-a9ca-7887a29157a0 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:25.344243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c426e9cf-e2ef-4ee9-a9ca-7887a29157a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:25.352273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d68fb-f21e-4ada-800a-9b0d2af29613 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.354661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1256/2549] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:25.358882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.359860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.360299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.360766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.361602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.362809 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.363241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.363527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.364231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.386295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:25.387505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:25.400136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1257/2550] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:25.404493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.408744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1294/2551] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:25.410575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.413000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:25.418967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c2e9b-7657-4fb1-96ad-aa9aea6f0d82 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.425542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.426570 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.426695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30ec12-ed27-477e-b936-f1833db3b500 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.427106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.427822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.429545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:25.430043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.432227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.432440 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.433255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.433596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.433935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.434871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.436483 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.456713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1258/2552] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:32:25.461745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1295/2553] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:25.462646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.469390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.474276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449aca-83f2-4a64-9b78-7b64d8abf6f8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.481950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.483663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.483663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.483663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.484166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ca005-fc5b-4606-880a-a24d0540bdb4 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.484337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.486574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.491180 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.493104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.493735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.494077 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] PATH_INFO: `/v3/projects/965c66859bca4204b61be29a8132773d/users/544324d0d7e348a596bc6ab8f5fd2925/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.520755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c66859bca4204b61be29a8132773d, user_id=544324d0d7e348a596bc6ab8f5fd2925, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.521253 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:25.531527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.538405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1259/2554] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:25.542166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.559332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1296/2555] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:25 2022] PUT /identity/v3/projects/965c66859bca4204b61be29a8132773d/users/544324d0d7e348a596bc6ab8f5fd2925/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:25.562305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.647280 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9c31b-b7f0-4416-899c-4fabbf69eff1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.650448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe301-aa45-48a2-8d77-5855824462a6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.655395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.656046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.656363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.656689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.657332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.659061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.663892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.665603 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.668976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.669273 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.669967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.672150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.677347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1297/2556] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:25.679444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.704422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872bfe-4aec-43e4-909b-d4ee7f740c2d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.706748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1260/2557] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:25.711258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.716274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.717356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.717774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.718193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] PATH_INFO: `/v3/projects/965c66859bca4204b61be29a8132773d/users/544324d0d7e348a596bc6ab8f5fd2925/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.721855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c66859bca4204b61be29a8132773d, user_id=544324d0d7e348a596bc6ab8f5fd2925, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.724893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32729-3c03-48c4-a346-af9cae3dd1b3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.727141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.733784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005108a7-8193-498d-8326-5c361ba47778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.734457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005108a7-8193-498d-8326-5c361ba47778 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.734815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005108a7-8193-498d-8326-5c361ba47778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.735091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005108a7-8193-498d-8326-5c361ba47778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.736022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005108a7-8193-498d-8326-5c361ba47778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.737729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005108a7-8193-498d-8326-5c361ba47778 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.743978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1298/2558] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:25 2022] PUT /identity/v3/projects/965c66859bca4204b61be29a8132773d/users/544324d0d7e348a596bc6ab8f5fd2925/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:25.751616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1261/2559] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:25.756882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.758993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.759358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.759710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.795049 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] MFA Rules not processed for user `544324d0d7e348a596bc6ab8f5fd2925`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:25.796401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:25.843737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c696-9c69-4bb3-af90-a531c8c8fa01 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.848949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.849582 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.849886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.850149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.850804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.853997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.865175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1299/2560] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:25.871351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.891315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00b656-10fd-43a5-b054-dd91308c34c8 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:25.900141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bf1cd-56a3-41ed-8ff7-4a074bf6079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:25.901347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf1cd-56a3-41ed-8ff7-4a074bf6079c admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.901820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf1cd-56a3-41ed-8ff7-4a074bf6079c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.902287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf1cd-56a3-41ed-8ff7-4a074bf6079c admin admin] PATH_INFO: `/v3/projects/5d51af965aa74568847164f28fd0d527/users/20c9521627d14d2ca4f977693b797c18/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:25.932250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1262/2561] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:25.935254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf1cd-56a3-41ed-8ff7-4a074bf6079c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d51af965aa74568847164f28fd0d527, user_id=20c9521627d14d2ca4f977693b797c18, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:25.941169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf1cd-56a3-41ed-8ff7-4a074bf6079c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:25.944276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:25.945947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:25.948517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:25.970760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1300/2562] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:25 2022] PUT /identity/v3/projects/5d51af965aa74568847164f28fd0d527/users/20c9521627d14d2ca4f977693b797c18/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:25.988555 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:25.988949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:25.989134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.044974 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a3243-c78a-413f-ba3c-92cdf4c69120 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.045839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] MFA Rules not processed for user `20c9521627d14d2ca4f977693b797c18`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:26.047858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:26.068651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:26.128071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.129158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.129648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.130229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.144477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1301/2563] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:26.149190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.208330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.210670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.222151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1263/2564] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:26.224835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8a806-8998-44ef-b22a-8a462efe9f32 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.231608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.232304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.232603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.232872 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.233532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.235590 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.300562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1302/2565] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:26 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:26.310786 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.331161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97b93-a893-4ddc-8ece-f4e0ab4f70b6 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.415155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.415785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.416065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.416339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.417060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.419039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.460521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.461579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1264/2566] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:26 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:26.474524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63374b5-acae-4b6b-8264-1f6dfca8de87 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.479612 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.480332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.480647 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.480951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.481700 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.483393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.496692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1303/2567] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:26.502533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.514250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138b74-5a3b-4350-8dfc-6b30858d0a84 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.535674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.536727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.538262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.538704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] PATH_INFO: `/v3/projects/da32ea9e7d0747918c25c5a54e2ce758/users/b45ca3d8b577451bba2f9c5359077280/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.586956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32ea9e7d0747918c25c5a54e2ce758, user_id=b45ca3d8b577451bba2f9c5359077280, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.591178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.617094 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1265/2568] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:26 2022] PUT /identity/v3/projects/da32ea9e7d0747918c25c5a54e2ce758/users/b45ca3d8b577451bba2f9c5359077280/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:26.621442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.633767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b379-9744-4e32-a58f-3c2a6a8fb91a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.736899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.737961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.738455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.738947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.740179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.744185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.746965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:26.773526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1304/2569] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:26.775553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.792852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61bba2-3029-48b9-9dfb-f4729f6f5b30 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.795827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:26.800576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc861f-1850-474e-a929-5c9a760dd9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.801737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc861f-1850-474e-a929-5c9a760dd9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.802203 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc861f-1850-474e-a929-5c9a760dd9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.802945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc861f-1850-474e-a929-5c9a760dd9e4 admin admin] PATH_INFO: `/v3/projects/da32ea9e7d0747918c25c5a54e2ce758/users/b45ca3d8b577451bba2f9c5359077280/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.807379 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc861f-1850-474e-a929-5c9a760dd9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32ea9e7d0747918c25c5a54e2ce758, user_id=b45ca3d8b577451bba2f9c5359077280, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.811694 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5495544-0935-4f8d-9a4d-e68790031f02 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:26.813337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc861f-1850-474e-a929-5c9a760dd9e4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.821075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:26.821891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.822315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.822763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] PATH_INFO: `/v3/users/fccb669827844b029013472dbe51c0e3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.824317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccb669827844b029013472dbe51c0e3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:26.827967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:26.837238 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1266/2570] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:26 2022] PUT /identity/v3/projects/da32ea9e7d0747918c25c5a54e2ce758/users/b45ca3d8b577451bba2f9c5359077280/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:26.850124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:26.850463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:26.850687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:26.889187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] MFA Rules not processed for user `b45ca3d8b577451bba2f9c5359077280`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:26.890478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:26.901647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:26.939877 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccb669827844b029013472dbe51c0e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:26.940909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccb669827844b029013472dbe51c0e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:26.953451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccb669827844b029013472dbe51c0e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:26.978111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccb669827844b029013472dbe51c0e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:26.988992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-76ae3260-4ec0-4ea9-99ae-b499f5a1aea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccb669827844b029013472dbe51c0e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:26.998050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1305/2571] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:26 2022] DELETE /identity/v3/users/fccb669827844b029013472dbe51c0e3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:27.006099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:27.007213 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:27.007904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:27.012514 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1267/2572] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:27.027306 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:27.029632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.039734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:27.041459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.132288 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1306/2573] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:27.148455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:27.150811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.156743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e603-8e90-47ad-9740-78e25d3916bc None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:27.256296 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:27.257854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:27.257854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:27.258191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:27.261055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.281205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240bab2-02cc-4700-b6a6-8d8b25dbb6d1 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:27.286632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:27.287532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:27.288004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:27.288525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:27.304205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:27.306169 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:27.319859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1307/2574] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:27.373467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:27.376231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:27.393687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1268/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:27.540094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:27.542614 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.565959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c808e-128b-4d54-908b-ab9e3e89140e service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:27.573652 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:27.575057 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:27.575635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:27.576195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:27.579954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.599182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:27.689837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:27.691318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:27.702909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1308/2576] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:27.824144 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:27.825834 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:27.850709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6dc7-3c11-4ffa-8876-49c1e146ee88 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:27.864436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:27.866002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:27.866362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:27.867300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] PATH_INFO: `/v3/projects/c0567cfb0b88486ca874db122fa3f886` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:27.869683 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0567cfb0b88486ca874db122fa3f886)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:27.873618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:27.893022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:27.971065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0567cfb0b88486ca874db122fa3f886', 'request_id': 'req-62db2401-3886-440b-aca6-b227da55c2fb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:27.981657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0567cfb0b88486ca874db122fa3f886', 'request_id': 'req-62db2401-3886-440b-aca6-b227da55c2fb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:27.992067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0567cfb0b88486ca874db122fa3f886', 'request_id': 'req-62db2401-3886-440b-aca6-b227da55c2fb'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.011138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] The token cache is being invalidate because project c0567cfb0b88486ca874db122fa3f886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:28.011580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.012416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.014230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1269/2577] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:27 2022] DELETE /identity/v3/projects/c0567cfb0b88486ca874db122fa3f886 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:28.019126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:28.032798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893946a-4a1d-4a5e-a481-9f15dae076a7 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:28.105648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:28.106309 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:28.106586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:28.106858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] PATH_INFO: `/v3/users/544324d0d7e348a596bc6ab8f5fd2925` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:28.108119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] RBAC: Authorizing `identity:delete_user(user_id=544324d0d7e348a596bc6ab8f5fd2925)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:28.110199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:28.181231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544324d0d7e348a596bc6ab8f5fd2925'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.181932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544324d0d7e348a596bc6ab8f5fd2925'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.193097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544324d0d7e348a596bc6ab8f5fd2925'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.214403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544324d0d7e348a596bc6ab8f5fd2925'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.225968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-ca81d51c-015f-4a8e-8bda-f0c7f0e0feab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544324d0d7e348a596bc6ab8f5fd2925'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.233307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1309/2578] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:28 2022] DELETE /identity/v3/users/544324d0d7e348a596bc6ab8f5fd2925 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:28.603611 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:28.605530 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:28.624247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db2401-3886-440b-aca6-b227da55c2fb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:28.718381 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:28.719448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:28.720100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:28.720602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] PATH_INFO: `/v3/projects/965c66859bca4204b61be29a8132773d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:28.722511 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965c66859bca4204b61be29a8132773d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:28.724926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:28.810209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965c66859bca4204b61be29a8132773d', 'request_id': 'req-596ac9d9-9f83-481e-a558-188bb9401230'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.817955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965c66859bca4204b61be29a8132773d', 'request_id': 'req-596ac9d9-9f83-481e-a558-188bb9401230'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.826234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965c66859bca4204b61be29a8132773d', 'request_id': 'req-596ac9d9-9f83-481e-a558-188bb9401230'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.841331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] The token cache is being invalidate because project 965c66859bca4204b61be29a8132773d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:28.841641 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.842277 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-596ac9d9-9f83-481e-a558-188bb9401230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:28.844225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1270/2579] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:28 2022] DELETE /identity/v3/projects/965c66859bca4204b61be29a8132773d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:28.850022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:28.850303 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:28.850584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:28.873287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:28.874540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:28.904965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:28.958735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1310/2580] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:28.968905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:28.969194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:28.969316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:28.999924 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:29.002360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:29.018352 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1271/2581] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:29.024024 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.040835 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe8fc7-e71e-4a66-98cc-1f6f09d04760 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.048856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.049485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.049876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.050197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.051125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:29.051656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.054621 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.069931 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1311/2582] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:29.075558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.086138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfb979-4391-464e-b070-38f1d0d94ce2 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.091447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.092078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.092353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.092652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.093308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.095606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.114346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:29.142211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1272/2583] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:29 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:29.149270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.160658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef26854-9814-4fd7-ae40-bb58f929dad3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.244014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.244951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.245400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.245824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.246870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.251003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.286417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1312/2584] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:29 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:29.291233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.305571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e9dd8-31bc-434d-9ba1-fefb54464da1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.311564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.312192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.312499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.312826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.313892 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.315546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.333014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1273/2585] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:29.337689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.351848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89af09-5cda-454e-bd44-a683aab4dc0d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.374879 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880d711-e610-426a-baa3-9779a885d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.376023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d711-e610-426a-baa3-9779a885d411 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.376486 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d711-e610-426a-baa3-9779a885d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.377060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d711-e610-426a-baa3-9779a885d411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.378190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d711-e610-426a-baa3-9779a885d411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.381466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d711-e610-426a-baa3-9779a885d411 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.403110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1313/2586] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:29.410090 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.426737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995b6f5-2c9a-476e-b790-770fb345050f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.432803 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.433794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.434184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.434735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] PATH_INFO: `/v3/projects/fbc9d83462584ccb802360a17518bec2/users/53481815e510405a8bb19a9635e00038/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.457211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc9d83462584ccb802360a17518bec2, user_id=53481815e510405a8bb19a9635e00038, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.461195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.484432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1274/2587] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:29 2022] PUT /identity/v3/projects/fbc9d83462584ccb802360a17518bec2/users/53481815e510405a8bb19a9635e00038/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:29.503837 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.504105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.504341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.536684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] MFA Rules not processed for user `53481815e510405a8bb19a9635e00038`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:29.537923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:29.618181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1314/2588] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:29.631859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.634730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:29.710022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e201-3362-4497-9b7b-47e21b08c926 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:29.715582 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:29.716608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:29.717119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:29.717593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:29.733987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:29.737004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:29.756889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1275/2589] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:29.958708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:29.960296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:29.998758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:30.038586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174aeb-1751-4869-baf9-151cb0636a92 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:30.042273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:30.043236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:30.044518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:30.044518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:30.046273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:30.140583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:30.142469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:30.154498 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1315/2590] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:34.856425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:34.858483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:34.877757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83b19a-dbdc-4ec0-abf9-736da16785a6 service glance] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:34.882749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:34.883413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:34.883700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:34.883972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] PATH_INFO: `/v3/users/de343953c3f24a4fbf8277edb098f165` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:34.900360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de343953c3f24a4fbf8277edb098f165)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:34.902784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:34.969195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de343953c3f24a4fbf8277edb098f165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:34.980451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de343953c3f24a4fbf8277edb098f165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:34.981592 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de343953c3f24a4fbf8277edb098f165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.003625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de343953c3f24a4fbf8277edb098f165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.013155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-4bdc0084-f80e-49e5-a733-b8dfa736fd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de343953c3f24a4fbf8277edb098f165'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.020698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1276/2591] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:34 2022] DELETE /identity/v3/users/de343953c3f24a4fbf8277edb098f165 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:35.262556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:35.274724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab694edb-93f0-460d-8a8a-7d97dc4fba13 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:35.344245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:35.345107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.345406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.345673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] PATH_INFO: `/v3/projects/28e74919cf5c4de5813d9b77cb1560ff` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.369488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e74919cf5c4de5813d9b77cb1560ff)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:35.373161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:35.437891 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e74919cf5c4de5813d9b77cb1560ff', 'request_id': 'req-297d0e43-5c0a-4b5b-a3d8-80319b8df042'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.446830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e74919cf5c4de5813d9b77cb1560ff', 'request_id': 'req-297d0e43-5c0a-4b5b-a3d8-80319b8df042'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.458793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e74919cf5c4de5813d9b77cb1560ff', 'request_id': 'req-297d0e43-5c0a-4b5b-a3d8-80319b8df042'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.474794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:35.488940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] The token cache is being invalidate because project 28e74919cf5c4de5813d9b77cb1560ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:35.489681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.490654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-297d0e43-5c0a-4b5b-a3d8-80319b8df042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:35.493219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1316/2592] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:35 2022] DELETE /identity/v3/projects/28e74919cf5c4de5813d9b77cb1560ff => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:35.498944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.499317 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.499632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.522420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:35.524267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:35.546161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:35.605178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1277/2593] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:35.614443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.614792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.615060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.648060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:35.650277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:35.668097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1317/2594] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:35.673839 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:35.691041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c974c-1fb4-4b70-ba50-cd088288ce09 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:35.700184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:35.701334 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.701826 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.702698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.703590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:35.704116 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:35.707695 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:35.728490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1278/2595] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:35.733495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:35.746815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350f15f-83b6-429c-b03b-65eec980eada None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:35.755301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:35.756017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.756419 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.756817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.757657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:35.761368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:35.832371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1318/2596] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:35 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:35.837802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:35.855321 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebec8d-d6ac-4e7e-ab0c-53aa0571e3a5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:35.874096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:35.876572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:35.960819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:35.961877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.962347 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.962872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.964009 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:35.967774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:35.973191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada92f2-967b-41fc-92b0-a54022de4d0c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:35.979023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:35.979859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:35.980244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:35.980847 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] PATH_INFO: `/v3/users/20c9521627d14d2ca4f977693b797c18` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:35.982388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c9521627d14d2ca4f977693b797c18)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:35.985828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:36.002866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1279/2597] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:35 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:36.010916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:36.032189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604436cc-9d0c-4c24-85d1-6113be2d7a5f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:36.045851 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:36.048323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.048903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.049610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.050494 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:36.053577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:36.065004 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c9521627d14d2ca4f977693b797c18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:36.067071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c9521627d14d2ca4f977693b797c18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:36.070948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1280/2598] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:36.076797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:36.080236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c9521627d14d2ca4f977693b797c18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:36.090698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bbd61-26d9-47b7-b857-0679c6783080 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:36.098497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:36.099478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.099820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.100151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.103849 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c9521627d14d2ca4f977693b797c18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:36.104078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:36.106177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:36.117976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9f6e963e-bf22-4cf2-9e55-31db22a66b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c9521627d14d2ca4f977693b797c18'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:36.118876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1281/2599] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:36.124886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:36.127234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:36.128373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1319/2600] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:35 2022] DELETE /identity/v3/users/20c9521627d14d2ca4f977693b797c18 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:36.133142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.133482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.133766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.146112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee4e8-fca6-4073-b91c-d83638eb7f24 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:36.159371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:36.161976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:36.240549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:36.248262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfdc59-377a-40c2-82dd-6d3479a54079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:36.249773 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfdc59-377a-40c2-82dd-6d3479a54079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.250923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfdc59-377a-40c2-82dd-6d3479a54079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.250923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfdc59-377a-40c2-82dd-6d3479a54079 admin admin] PATH_INFO: `/v3/projects/bc4c1de835694b8bb11828f344f5e133/users/9a6d250137c44c39b555e47451207fc7/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.267639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1320/2601] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:36.278242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:36.279691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:36.281780 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfdc59-377a-40c2-82dd-6d3479a54079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4c1de835694b8bb11828f344f5e133, user_id=9a6d250137c44c39b555e47451207fc7, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:36.287975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfdc59-377a-40c2-82dd-6d3479a54079 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:36.318648 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1282/2602] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:36 2022] PUT /identity/v3/projects/bc4c1de835694b8bb11828f344f5e133/users/9a6d250137c44c39b555e47451207fc7/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:36.337180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.337681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.338169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.350671 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:36.353636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b77039-6b1a-4281-9d22-a546c40c62a7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:36.383040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] MFA Rules not processed for user `9a6d250137c44c39b555e47451207fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:36.384591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:36.428821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:36.429457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.429734 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.430000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.492302 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1283/2603] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:36.513550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:36.517797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:36.541896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:36.543909 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:36.556569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1321/2604] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:36.680189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c29016-ded4-43ed-9bc9-69403cb9fe62 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:36.687298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:36.688107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:36.688513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:36.688978 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:36.699716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:36.701937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:36.715248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1284/2605] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:37.009250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:37.013296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:37.047142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca837-e1ab-48a2-b51e-cc1a7a8010b4 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:37.055751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:37.056338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:37.056718 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:37.057113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] PATH_INFO: `/v3/projects/5d51af965aa74568847164f28fd0d527` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:37.058850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d51af965aa74568847164f28fd0d527)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:37.060889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:37.134821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:37.136876 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d51af965aa74568847164f28fd0d527', 'request_id': 'req-e9f87eb9-2009-4928-af7e-a8d2f291b118'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.145905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d51af965aa74568847164f28fd0d527', 'request_id': 'req-e9f87eb9-2009-4928-af7e-a8d2f291b118'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.157193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d51af965aa74568847164f28fd0d527', 'request_id': 'req-e9f87eb9-2009-4928-af7e-a8d2f291b118'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.172144 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] The token cache is being invalidate because project 5d51af965aa74568847164f28fd0d527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:37.172438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.173191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.175915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1322/2606] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:37 2022] DELETE /identity/v3/projects/5d51af965aa74568847164f28fd0d527 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:37.182353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:37.205449 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99700eee-39bd-4bc8-acfb-b6c4c8f0391d service nova] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:37.325075 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:37.339264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:37.340357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:37.340958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:37.341440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] PATH_INFO: `/v3/users/b45ca3d8b577451bba2f9c5359077280` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:37.344132 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45ca3d8b577451bba2f9c5359077280)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:37.348027 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:37.440063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45ca3d8b577451bba2f9c5359077280'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.452560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45ca3d8b577451bba2f9c5359077280'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.454255 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45ca3d8b577451bba2f9c5359077280'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.476527 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45ca3d8b577451bba2f9c5359077280'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.495750 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-06ee9958-c776-4508-b53f-ff7cd20fb048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45ca3d8b577451bba2f9c5359077280'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:37.508131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1285/2607] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:37 2022] DELETE /identity/v3/users/b45ca3d8b577451bba2f9c5359077280 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:37.897517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:37.899833 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:37.915209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87eb9-2009-4928-af7e-a8d2f291b118 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.001770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.002626 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.002956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.003279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] PATH_INFO: `/v3/projects/da32ea9e7d0747918c25c5a54e2ce758` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.004866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da32ea9e7d0747918c25c5a54e2ce758)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.007157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.081094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da32ea9e7d0747918c25c5a54e2ce758', 'request_id': 'req-56315c1c-37bb-4008-8869-4c8096cdbc88'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:38.087693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da32ea9e7d0747918c25c5a54e2ce758', 'request_id': 'req-56315c1c-37bb-4008-8869-4c8096cdbc88'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:38.099063 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da32ea9e7d0747918c25c5a54e2ce758', 'request_id': 'req-56315c1c-37bb-4008-8869-4c8096cdbc88'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:38.111559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] The token cache is being invalidate because project da32ea9e7d0747918c25c5a54e2ce758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:38.111852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:38.112552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-56315c1c-37bb-4008-8869-4c8096cdbc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:38.114150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1323/2608] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:37 2022] DELETE /identity/v3/projects/da32ea9e7d0747918c25c5a54e2ce758 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:38.122736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.123225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.123725 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.161481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:38.165518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:38.272719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1286/2609] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:38.285430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.285824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.285939 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.316228 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:38.318254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:38.332917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1324/2610] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:38.337814 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:38.349838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6c0-a876-47d6-bec8-8dc9828cb276 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.356336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.357216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.357495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.357766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.358667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:38.359036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.362018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.379156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1287/2611] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:38.384102 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:38.395008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9dd3-bbfd-44d6-bb64-66e41900759a None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.400819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.401934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.402367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.402782 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.403825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.407386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.456655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1325/2612] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:38 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:38.462112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:38.483087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ec70-1d9f-40b0-a3db-8f210b42a384 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.595493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.596895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.597519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.597993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.599698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.603552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.622876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:38.639046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1288/2613] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:38 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:38.642995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:38.663627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cd82f-3b07-410c-8901-b62e1cffc71d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.671126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.671761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.672092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.672462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.673523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.675164 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.687932 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1326/2614] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:38.693020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:38.706463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa8ce-bdac-4d90-9d0f-247f3d60d2b3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.712463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba96b3-ad44-4f6a-8152-3de075dde562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.713235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba96b3-ad44-4f6a-8152-3de075dde562 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.713571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba96b3-ad44-4f6a-8152-3de075dde562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.713913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba96b3-ad44-4f6a-8152-3de075dde562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.714852 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba96b3-ad44-4f6a-8152-3de075dde562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.716688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba96b3-ad44-4f6a-8152-3de075dde562 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.741287 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1289/2615] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:38.751761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:38.769792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984aa11-f4bc-41e2-be50-09af3818edce admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:38.778013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:38.779127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.779595 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.780066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] PATH_INFO: `/v3/projects/877b831c79b54d00bb500b890cc7e2d8/users/e1c69d1e4f7c476f96f3e4267d8b653a/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.807927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877b831c79b54d00bb500b890cc7e2d8, user_id=e1c69d1e4f7c476f96f3e4267d8b653a, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:38.811032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:38.828866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1327/2616] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:38 2022] PUT /identity/v3/projects/877b831c79b54d00bb500b890cc7e2d8/users/e1c69d1e4f7c476f96f3e4267d8b653a/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:38.841798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:38.842260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:38.842595 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:38.893715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] MFA Rules not processed for user `e1c69d1e4f7c476f96f3e4267d8b653a`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:38.895089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:39.012369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1290/2617] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:39.019279 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.024450 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:39.121014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d4a1-9ab7-442a-af90-70ecd5328317 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.129737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.130903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.131502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.132098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.133470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.137250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.170266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1328/2618] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:39.175460 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.193100 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd47e8-049d-43eb-a02c-443bdf51c24c None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.288914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.290131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.290131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.290131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.290772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.292847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.318919 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1291/2619] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:39 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:39.323085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.334336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246f00-2e86-4d2b-9e03-06b41b6cb520 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.339914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.341030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.341508 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.342008 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.343185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.346455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.368310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1329/2620] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:39.372954 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.386998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c74a3-3452-4259-be53-8c18242d6adc admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.394205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.395756 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.396348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.397624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] PATH_INFO: `/v3/projects/8e4eb48aaede4058999426ee54d5abc2/users/07e4207aca66425bbbfedda539b8c115/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.429806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4eb48aaede4058999426ee54d5abc2, user_id=07e4207aca66425bbbfedda539b8c115, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.434926 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.455398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1292/2621] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:39 2022] PUT /identity/v3/projects/8e4eb48aaede4058999426ee54d5abc2/users/07e4207aca66425bbbfedda539b8c115/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:39.459978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.473104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e512fd-dc05-4968-9429-20a556c96ea1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.555159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5a5d3-9916-4414-ab12-ded2fcebd76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.555805 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5a5d3-9916-4414-ab12-ded2fcebd76a admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.556091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5a5d3-9916-4414-ab12-ded2fcebd76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.556346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5a5d3-9916-4414-ab12-ded2fcebd76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.557175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5a5d3-9916-4414-ab12-ded2fcebd76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.558925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5a5d3-9916-4414-ab12-ded2fcebd76a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.572212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1330/2622] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:39.576808 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.591692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f71b98-8c80-4277-a053-92f1b6f0ca96 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.599666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.600884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.601175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.601503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] PATH_INFO: `/v3/projects/8e4eb48aaede4058999426ee54d5abc2/users/07e4207aca66425bbbfedda539b8c115/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.604345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4eb48aaede4058999426ee54d5abc2, user_id=07e4207aca66425bbbfedda539b8c115, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.608390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.625662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1293/2623] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:39 2022] PUT /identity/v3/projects/8e4eb48aaede4058999426ee54d5abc2/users/07e4207aca66425bbbfedda539b8c115/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:39.642122 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f616c-fa26-46ec-be5b-59296147486e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.642507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f616c-fa26-46ec-be5b-59296147486e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.642824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f616c-fa26-46ec-be5b-59296147486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.678986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-802f616c-fa26-46ec-be5b-59296147486e None None] MFA Rules not processed for user `07e4207aca66425bbbfedda539b8c115`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:39.680254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-802f616c-fa26-46ec-be5b-59296147486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:39.763092 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:39.781133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1331/2624] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:39.790805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:39.793761 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:39.843004 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:39.885822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7cd5-646e-4e34-a3d9-66d2584adf18 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:39.889515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:39.890146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:39.890729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:39.891206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:39.901330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:39.902801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:39.914789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1294/2625] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:40.000465 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f616c-fa26-46ec-be5b-59296147486e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:40.087359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f616c-fa26-46ec-be5b-59296147486e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:40.095236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:40.096357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:40.096908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:40.097399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] PATH_INFO: `/v3/users/e1c69d1e4f7c476f96f3e4267d8b653a` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:40.099973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c69d1e4f7c476f96f3e4267d8b653a)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:40.103943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:40.210743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c69d1e4f7c476f96f3e4267d8b653a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:40.211645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c69d1e4f7c476f96f3e4267d8b653a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:40.223276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c69d1e4f7c476f96f3e4267d8b653a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:40.225083 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:40.240057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775740f-30cc-4b30-b035-ad0354d5acbb service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:40.245098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:40.245727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:40.246005 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:40.246330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:40.247896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c69d1e4f7c476f96f3e4267d8b653a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:40.248467 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:40.258510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c7c29883-787e-4fcf-88d0-e30970e26e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c69d1e4f7c476f96f3e4267d8b653a'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:40.267071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1332/2626] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:39 2022] DELETE /identity/v3/users/e1c69d1e4f7c476f96f3e4267d8b653a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:40.274927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:40.275502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:40.275886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:40.314697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:40.317003 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:40.345076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:40.346704 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:40.360410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1295/2627] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:40.411345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1333/2628] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:40.443685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:40.446583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:40.538723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0e57-6a8f-4fe1-a796-483ac5957f32 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:40.597904 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:40.598550 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:40.598833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:40.599106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:40.613549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:40.615297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:40.627913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1296/2629] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:41.047093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:41.049632 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:41.077333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ef36-a375-4c8b-9bc5-19f9a020dccd None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:41.087264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:41.088795 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:41.089705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:41.090120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] PATH_INFO: `/v3/projects/877b831c79b54d00bb500b890cc7e2d8` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:41.092779 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877b831c79b54d00bb500b890cc7e2d8)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:41.095804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:41.116242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:41.167640 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877b831c79b54d00bb500b890cc7e2d8', 'request_id': 'req-8e56f846-7e64-4195-898f-9401b77538f7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.174844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877b831c79b54d00bb500b890cc7e2d8', 'request_id': 'req-8e56f846-7e64-4195-898f-9401b77538f7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.186134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877b831c79b54d00bb500b890cc7e2d8', 'request_id': 'req-8e56f846-7e64-4195-898f-9401b77538f7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.198417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] The token cache is being invalidate because project 877b831c79b54d00bb500b890cc7e2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:41.198708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.199378 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.200964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1334/2630] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:41 2022] DELETE /identity/v3/projects/877b831c79b54d00bb500b890cc7e2d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:41.205640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:41.216498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91d24-96a5-4f09-bd37-28ab33c0a518 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:41.225576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=100 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:41.301549 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:41.302331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:41.302821 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:41.303260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] PATH_INFO: `/v3/users/07e4207aca66425bbbfedda539b8c115` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:41.305060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e4207aca66425bbbfedda539b8c115)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:41.309425 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:41.391026 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e4207aca66425bbbfedda539b8c115'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.402788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e4207aca66425bbbfedda539b8c115'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.403687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e4207aca66425bbbfedda539b8c115'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.421496 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e4207aca66425bbbfedda539b8c115'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.431488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-23dce17c-9105-4feb-a0d0-ea3348b70951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e4207aca66425bbbfedda539b8c115'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:41.439410 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1297/2631] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:41 2022] DELETE /identity/v3/users/07e4207aca66425bbbfedda539b8c115 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:41.867763 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:41.870447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:41.915499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f846-7e64-4195-898f-9401b77538f7 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.024073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.025197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.025664 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.026123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] PATH_INFO: `/v3/projects/8e4eb48aaede4058999426ee54d5abc2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.027873 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4eb48aaede4058999426ee54d5abc2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.030294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.115031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4eb48aaede4058999426ee54d5abc2', 'request_id': 'req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:42.125521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4eb48aaede4058999426ee54d5abc2', 'request_id': 'req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:42.137984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4eb48aaede4058999426ee54d5abc2', 'request_id': 'req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:42.152075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] The token cache is being invalidate because project 8e4eb48aaede4058999426ee54d5abc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:42.152340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:42.153162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c262a3fe-97de-4e7a-814b-3cb3f9741c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:42.154916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1335/2632] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:41 2022] DELETE /identity/v3/projects/8e4eb48aaede4058999426ee54d5abc2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:42.161551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.161888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.162205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.190521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:42.191759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:42.265860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1298/2633] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:42.275408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.275838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.276149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.299903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:42.301078 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:42.310811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1336/2634] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:42.315746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.327040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99361-6657-4fdf-8692-93add4caa911 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.332662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.333453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.333737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.334018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.334676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:42.334979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.336652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.350629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1299/2635] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:42.356426 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.369381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dbad6-d1d0-4c5b-865f-08012d7cbaa3 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.377904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.379096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.379571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.380048 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.381247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.385034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.436609 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1337/2636] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:42.442156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.461325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dae62-db46-4996-827b-4afe356912c5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.479966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:42.536368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.537039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.537319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.537591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.538243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.540216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.571976 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1300/2637] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:42 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:42.576413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.582433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:42.590357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a522158-1358-4bd7-a785-d0102d47a8ca admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.598340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.599015 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.599369 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.599681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.600455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.602347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.614747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1338/2638] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:42.619937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.631813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f55d-dc08-4c3e-8937-4b36d5aff5a2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.637101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99917-d1a2-432e-b58d-2eb2d63f8620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.637732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99917-d1a2-432e-b58d-2eb2d63f8620 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.638002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99917-d1a2-432e-b58d-2eb2d63f8620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.638272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99917-d1a2-432e-b58d-2eb2d63f8620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.638930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99917-d1a2-432e-b58d-2eb2d63f8620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.640558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99917-d1a2-432e-b58d-2eb2d63f8620 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.652828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1301/2639] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:42.658318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.669708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b40b9e-8e2d-4b8e-8fd6-1492b37dcab0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.675925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.676906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.677274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.677635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] PATH_INFO: `/v3/projects/a0daf0788c144170b092fe255d8c407e/users/cf5da7989da343ad9a652dba8a05c05e/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.709383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0daf0788c144170b092fe255d8c407e, user_id=cf5da7989da343ad9a652dba8a05c05e, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.714681 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:42.735184 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1339/2640] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:42 2022] PUT /identity/v3/projects/a0daf0788c144170b092fe255d8c407e/users/cf5da7989da343ad9a652dba8a05c05e/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:42.748614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.749103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.749374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.785588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] MFA Rules not processed for user `cf5da7989da343ad9a652dba8a05c05e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:42.786855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:42.818592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.821100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:42.866477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1302/2641] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:42.871340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:42.916957 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8584f14-8c56-46c7-9715-44bbd6108824 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.921443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.922402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.922713 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.923041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.925796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:42.967366 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e610be-5eae-4fd8-a06d-fd794adb763d None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:42.974016 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:42.975067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:42.975542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:42.975993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:42.977222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:42.982179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.020687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.022179 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.026501 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1303/2642] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:43.033670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.041977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1340/2643] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:43.053898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:43.131543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b01f0-86f4-4d67-9a0c-5cf97707c074 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.144742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.145552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.145960 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.146307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.146999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.149012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.184648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.186938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:43.188816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1304/2644] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:43 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:43.190763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.202376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595ad1-215c-4eea-b16c-777650dfa901 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.207949 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6e2a-ddd0-4a62-bf00-4eeb457f8270 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.208375 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.209159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.209502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.209839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] PATH_INFO: `/v3/users/9a6d250137c44c39b555e47451207fc7` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.211096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6d250137c44c39b555e47451207fc7)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.213182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.215791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.216866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.217323 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.217788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.219036 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.221939 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.239499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1305/2645] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:43.245307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.258497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b474bc9-1df0-4236-9d15-0fa804e1ad52 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.265454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.266930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.267131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.267476 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] PATH_INFO: `/v3/projects/40fbcecabf154e899c62f8ef7673476e/users/799db4b637924a138555dbcbebebdd8e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.279323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6d250137c44c39b555e47451207fc7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:43.280075 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6d250137c44c39b555e47451207fc7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:43.288922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fbcecabf154e899c62f8ef7673476e, user_id=799db4b637924a138555dbcbebebdd8e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.291301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6d250137c44c39b555e47451207fc7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:43.293030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.301777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:43.313195 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6d250137c44c39b555e47451207fc7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:43.313886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1306/2646] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:43 2022] PUT /identity/v3/projects/40fbcecabf154e899c62f8ef7673476e/users/799db4b637924a138555dbcbebebdd8e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:43.320292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.327159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1651615f-bc47-4585-8fda-b77eb807f4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6d250137c44c39b555e47451207fc7'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:43.337657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1341/2647] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:43 2022] DELETE /identity/v3/users/9a6d250137c44c39b555e47451207fc7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:43.343395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.344133 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.344585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.374780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:43.377970 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:43.431579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019cf4-2863-44c9-ba0f-d981bb3eb37e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.476920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1342/2648] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:43.490019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.492749 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:43.516483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.517590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.517590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.517590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.518210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.519888 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.531801 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1307/2649] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:43.536080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.538060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:43.553299 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a71982-05f1-41fb-8458-ee17e2ada0d2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.557901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa0c8e-78af-4bcf-a93b-19f3279cd15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.558616 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa0c8e-78af-4bcf-a93b-19f3279cd15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.558905 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa0c8e-78af-4bcf-a93b-19f3279cd15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.559185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa0c8e-78af-4bcf-a93b-19f3279cd15c admin admin] PATH_INFO: `/v3/projects/40fbcecabf154e899c62f8ef7673476e/users/799db4b637924a138555dbcbebebdd8e/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.561261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa0c8e-78af-4bcf-a93b-19f3279cd15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fbcecabf154e899c62f8ef7673476e, user_id=799db4b637924a138555dbcbebebdd8e, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.563957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa0c8e-78af-4bcf-a93b-19f3279cd15c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.568208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:43.576968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793759-018a-41ac-b7aa-40275115ffb6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.577594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1308/2650] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:43 2022] PUT /identity/v3/projects/40fbcecabf154e899c62f8ef7673476e/users/799db4b637924a138555dbcbebebdd8e/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:43.590177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.590668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.591080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.637775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] MFA Rules not processed for user `799db4b637924a138555dbcbebebdd8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:43.638944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:43.657583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.658407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.658831 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.659285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.723627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:43.727934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1309/2651] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:43.740525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:43.742343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:43.749820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.751604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.762562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1343/2652] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:43.847445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8e84b-7ef2-414e-aac2-1544ffae49f5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:43.854150 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:43.855590 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:43.856070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:43.856534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:43.874539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:43.877158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:43.895886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1310/2653] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:44.024468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.037013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f938-70ca-4ee9-bac3-0c17aa9e2f93 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.042395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.043034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.043357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.043547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.046264 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.123526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.125194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116b71-71cb-4fa4-ac6f-f23e068c3fd2 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.129224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.131210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.136027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1344/2654] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:44.157639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cb09-4d4a-44b0-b088-727f444b38df service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.166699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.170862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.172333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.172867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] PATH_INFO: `/v3/projects/bc4c1de835694b8bb11828f344f5e133` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.175197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4c1de835694b8bb11828f344f5e133)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.181221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.269918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4c1de835694b8bb11828f344f5e133', 'request_id': 'req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.278802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4c1de835694b8bb11828f344f5e133', 'request_id': 'req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.290500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4c1de835694b8bb11828f344f5e133', 'request_id': 'req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.309788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] The token cache is being invalidate because project bc4c1de835694b8bb11828f344f5e133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:44.310421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.311572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-8ee2323f-9d6e-4014-bab6-9d2207a0ecbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.314364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1311/2655] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:44 2022] DELETE /identity/v3/projects/bc4c1de835694b8bb11828f344f5e133 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:44.321513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.322275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.322275 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.348953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:44.350208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.447832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1345/2656] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:44.459736 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.460259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.460795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.484423 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:44.489727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:44.492235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.505456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1312/2657] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:44.510020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.521583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312a5aa-c47c-4174-888b-2c2af3c03668 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.527431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.528114 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.528484 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.529039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.530087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:44.530856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.532823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.539950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.542589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.548012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1346/2658] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:44.552564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.565525 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca33ea-e015-4824-8ac9-bc3cca60ae96 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.566902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f3b47-6af1-4d17-8c26-2fb08fa24706 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.573411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.574451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.574602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.575018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.575529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.575664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.575986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.576420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] PATH_INFO: `/v3/users/cf5da7989da343ad9a652dba8a05c05e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.576903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.578307 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5da7989da343ad9a652dba8a05c05e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.580499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.582741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.628001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1347/2659] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:44 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:44.635966 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.660243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5da7989da343ad9a652dba8a05c05e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.670925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5da7989da343ad9a652dba8a05c05e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.671711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5da7989da343ad9a652dba8a05c05e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.687927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5da7989da343ad9a652dba8a05c05e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.696239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e68645d5-8cea-4427-a00f-3526c75ccf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5da7989da343ad9a652dba8a05c05e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:44.704783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1313/2660] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:44 2022] DELETE /identity/v3/users/cf5da7989da343ad9a652dba8a05c05e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:44.709512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.709911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.710260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.719291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:44.732311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:44.733722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.734666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c181af-f838-4ac3-bda2-aa73d41d9c91 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.814074 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1314/2661] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:44.818569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.819269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.819474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.819746 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.820557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.823836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.826200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.827922 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.848070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1348/2662] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:44 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:44.855384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.857000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:44.870209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356988b4-5a48-4ef4-83f0-e1b444a4d13e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.878035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.879012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.879497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.879958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.881347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.884250 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.899244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1349/2663] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:44.900821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.902297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366db070-78e6-43b5-bff8-5728595ace9b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.907089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646642f-f29c-4e8d-8456-ed15c22de063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.908316 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646642f-f29c-4e8d-8456-ed15c22de063 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.908601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646642f-f29c-4e8d-8456-ed15c22de063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.908923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646642f-f29c-4e8d-8456-ed15c22de063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.911403 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1c01-9572-4c53-a71d-ac9dd830a30f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.916340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.916982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.917258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.917524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.918170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.919815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.924562 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646642f-f29c-4e8d-8456-ed15c22de063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.927519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646642f-f29c-4e8d-8456-ed15c22de063 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:44.935716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1350/2664] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:44.940848 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:44.944033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1315/2665] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:44.952521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5aa87-7573-47f6-bd1e-0844a8c2f97f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:44.958370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:44.959055 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:44.959376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:44.959583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] PATH_INFO: `/v3/projects/14505ba5f28e4b1fa823ad6220b73697/users/952ad7166454421f9336c207181563c6/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:44.978148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=14505ba5f28e4b1fa823ad6220b73697, user_id=952ad7166454421f9336c207181563c6, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:44.982695 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.004787 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1351/2666] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:44 2022] PUT /identity/v3/projects/14505ba5f28e4b1fa823ad6220b73697/users/952ad7166454421f9336c207181563c6/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:45.023223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.023708 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.024162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.067643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] MFA Rules not processed for user `952ad7166454421f9336c207181563c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:45.069190 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:45.076129 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:45.183012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1316/2667] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:45.191243 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.273215 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ec5db-b447-42d6-88bf-6a9b14a218bf admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.278820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.279651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.279982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.280360 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.281299 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.283685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.321444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1352/2668] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:45 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:45.328827 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.329557 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.332242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:45.363227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba704b80-70ed-4511-a1f7-0053a18567ee None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.374533 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:45.435992 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f19bc-512e-4eb1-9e26-6ac04fa9a002 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.441824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.442607 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.442977 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.443345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.443547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.444193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.444437 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.444955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.445432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] PATH_INFO: `/v3/projects/a0daf0788c144170b092fe255d8c407e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.447150 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.447348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0daf0788c144170b092fe255d8c407e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.450748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.480124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1353/2669] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:45 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:45.481396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.499497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5febff-39cf-4707-b233-100b9c8be48a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.507324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.508443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.509052 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.509556 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.510657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.513934 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.529121 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0daf0788c144170b092fe255d8c407e', 'request_id': 'req-5962ad1d-5deb-4573-b019-c0773983a898'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.533917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1354/2670] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:45.535906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0daf0788c144170b092fe255d8c407e', 'request_id': 'req-5962ad1d-5deb-4573-b019-c0773983a898'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.538744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.543216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0daf0788c144170b092fe255d8c407e', 'request_id': 'req-5962ad1d-5deb-4573-b019-c0773983a898'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.554340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b119cc-7c51-4d2c-8351-9a52bd442f61 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.558729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] The token cache is being invalidate because project a0daf0788c144170b092fe255d8c407e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:45.559028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.559810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.561571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1317/2671] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:45 2022] DELETE /identity/v3/projects/a0daf0788c144170b092fe255d8c407e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:45.566246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.568021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:45.625999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:45.654961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962ad1d-5deb-4573-b019-c0773983a898 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.657123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.657810 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.658134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.658402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] PATH_INFO: `/v3/projects/36521caf8d4c4c6cb26a65f6519db223/users/98f804df94d94a3c94599121bf4f9611/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.665262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.665916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.666200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.666466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] PATH_INFO: `/v3/users/799db4b637924a138555dbcbebebdd8e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.667807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799db4b637924a138555dbcbebebdd8e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.669788 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.675706 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36521caf8d4c4c6cb26a65f6519db223, user_id=98f804df94d94a3c94599121bf4f9611, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.678442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.696006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1355/2672] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:45 2022] PUT /identity/v3/projects/36521caf8d4c4c6cb26a65f6519db223/users/98f804df94d94a3c94599121bf4f9611/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:45.700193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.702386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:45.733325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799db4b637924a138555dbcbebebdd8e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.743705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799db4b637924a138555dbcbebebdd8e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.744356 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799db4b637924a138555dbcbebebdd8e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.760271 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799db4b637924a138555dbcbebebdd8e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.769996 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799db4b637924a138555dbcbebebdd8e'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:45.778065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1318/2673] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:45 2022] DELETE /identity/v3/users/799db4b637924a138555dbcbebebdd8e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:45.813090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bb91-2509-4e0b-bbd6-0fe9e75f7659 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.872719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:45.924314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda195-d6fe-41cd-b5f8-33fc1d48dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.927460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda195-d6fe-41cd-b5f8-33fc1d48dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.927739 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda195-d6fe-41cd-b5f8-33fc1d48dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.928016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda195-d6fe-41cd-b5f8-33fc1d48dfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.928723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facda195-d6fe-41cd-b5f8-33fc1d48dfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.930406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facda195-d6fe-41cd-b5f8-33fc1d48dfd4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:45.946160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1356/2674] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:45.958452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:45.958452 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:45.971165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a427cc-120f-400f-a0b4-d161540d6680 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:45.976300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:45.977044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:45.977349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:45.989174 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] PATH_INFO: `/v3/projects/36521caf8d4c4c6cb26a65f6519db223/users/98f804df94d94a3c94599121bf4f9611/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:45.992658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36521caf8d4c4c6cb26a65f6519db223, user_id=98f804df94d94a3c94599121bf4f9611, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:45.995752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.007559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1319/2675] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:45 2022] PUT /identity/v3/projects/36521caf8d4c4c6cb26a65f6519db223/users/98f804df94d94a3c94599121bf4f9611/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:46.018270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.018574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.018811 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.058357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] MFA Rules not processed for user `98f804df94d94a3c94599121bf4f9611`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:46.059758 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.122890 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.124823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.157890 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1357/2676] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:46.173534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.175157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.205298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ee67-9478-4923-8131-a7a2712b2391 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.210454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.211182 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.211479 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.211720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] PATH_INFO: `/v3/projects/40fbcecabf154e899c62f8ef7673476e` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.213242 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fbcecabf154e899c62f8ef7673476e)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.215963 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.277770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:46.282929 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fbcecabf154e899c62f8ef7673476e', 'request_id': 'req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:46.291333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fbcecabf154e899c62f8ef7673476e', 'request_id': 'req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:46.300015 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fbcecabf154e899c62f8ef7673476e', 'request_id': 'req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:46.319864 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] The token cache is being invalidate because project 40fbcecabf154e899c62f8ef7673476e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:46.320753 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:46.321518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-eb15900f-e88e-4d27-b5b3-7ce65c6a853f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:46.324382 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1320/2677] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:46 2022] DELETE /identity/v3/projects/40fbcecabf154e899c62f8ef7673476e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:46.331913 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a5a5-4ff0-44c9-9f43-be87acac24fb None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.332395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a5a5-4ff0-44c9-9f43-be87acac24fb None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.332825 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a5a5-4ff0-44c9-9f43-be87acac24fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.363971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0f06a5a5-4ff0-44c9-9f43-be87acac24fb None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:46.365361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0f06a5a5-4ff0-44c9-9f43-be87acac24fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.385544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1acf91-366d-4375-a84e-0eb812f563c5 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.436977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1321/2678] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:46.446427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.446818 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.447087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.457959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.458474 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.458744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.459009 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.461194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.473204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:46.474692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.486513 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1322/2679] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:46.493136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.496547 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:46.509128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b33c2-4624-4602-be38-64a6fc67aa11 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.514470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.515246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.515571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.515771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.516353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:46.516877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.518522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.531092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1323/2680] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:32:46.535732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.547895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d50b2-62ea-4089-a497-71d7c2a726ec admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.548780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.550201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.553827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.554445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.558022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.558022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.558022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.558022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.564196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1358/2681] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:32:46.593013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1324/2682] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:46 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:46.597585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.609855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f29be-1ff5-44b6-9336-5893d21accf8 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.654293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.656804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.694584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.695536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.695986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.696420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.697567 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.701118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.725494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1359/2683] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:46 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:46.730354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.737938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50365b-73d5-4532-a8a6-50ce6b4cb31b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.743353 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.743551 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc70a6-ccc6-428b-8e7a-f7d9a674a0d1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.743666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.743666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.743860 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.746024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:46.748651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.749466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.749767 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.750034 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.750719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.752315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.766780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1360/2684] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:46.771363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.784538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa3dd2-db1e-4ea3-89b2-a61c287b3b9c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.791619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.792642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.793107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.793539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.794605 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.797558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.809079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:46.815748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1361/2685] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:46.820948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:46.833661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.834011 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff9e32-eee8-47bd-8f30-e24e30f08f67 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:46.835137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d12b1b-65a8-4e00-9add-09ef074d52dc service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.838586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:46.839252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.839515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.839955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] PATH_INFO: `/v3/projects/725b2f070de14e93b2d4b299046c9c12/users/e4562506ce9b4a74bf45af01ecb12e59/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.846769 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1325/2686] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:46.856477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=725b2f070de14e93b2d4b299046c9c12, user_id=e4562506ce9b4a74bf45af01ecb12e59, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:46.859137 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:46.875080 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1362/2687] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:46 2022] PUT /identity/v3/projects/725b2f070de14e93b2d4b299046c9c12/users/e4562506ce9b4a74bf45af01ecb12e59/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:46.886698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430861-f9ce-4207-af72-410400c09421 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:46.887141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430861-f9ce-4207-af72-410400c09421 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:46.887559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430861-f9ce-4207-af72-410400c09421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:46.923807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-68430861-f9ce-4207-af72-410400c09421 None None] MFA Rules not processed for user `e4562506ce9b4a74bf45af01ecb12e59`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:46.925662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-68430861-f9ce-4207-af72-410400c09421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:47.024668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1326/2688] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:47.028773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.125000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd842da0-f1d5-428e-9662-aa7ea5acc435 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.138066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.139019 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.139298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.139569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.140226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.142208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.155610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:47.176802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1363/2689] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:47 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:47.181187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430861-f9ce-4207-af72-410400c09421 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.193153 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430861-f9ce-4207-af72-410400c09421 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.259197 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.259737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.260010 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.260279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.260971 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.262951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.288774 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1327/2690] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:47 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:47.292886 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.304371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f923275-582d-4c3c-ba54-9777ae7799f0 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.309411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.310035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.310310 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.310581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.311231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.313110 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.325152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1364/2691] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:47.329643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.339950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143eacc-77c0-447e-b4e2-fb55540c5e49 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.345267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.346097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.346493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.346879 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] PATH_INFO: `/v3/projects/896bb50dc324457484da1608c39fd871/users/4c9a3d3b6a874b2bb66eed5122edef87/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.364856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896bb50dc324457484da1608c39fd871, user_id=4c9a3d3b6a874b2bb66eed5122edef87, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.367907 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.385741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1328/2692] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:47 2022] PUT /identity/v3/projects/896bb50dc324457484da1608c39fd871/users/4c9a3d3b6a874b2bb66eed5122edef87/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:47.389912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.400774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632383c-95db-42aa-9ee6-349bb4badaec admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.460471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fe320-3bfb-469d-8aa0-656f36cf1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.461123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fe320-3bfb-469d-8aa0-656f36cf1fee admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.461398 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fe320-3bfb-469d-8aa0-656f36cf1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.461673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fe320-3bfb-469d-8aa0-656f36cf1fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.462321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fe320-3bfb-469d-8aa0-656f36cf1fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.463940 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fe320-3bfb-469d-8aa0-656f36cf1fee admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.475135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1365/2693] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:47.480796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.492504 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f6e78-2892-416e-8ade-af9d61b39054 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.497654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.498367 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.498644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.498917 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] PATH_INFO: `/v3/projects/896bb50dc324457484da1608c39fd871/users/4c9a3d3b6a874b2bb66eed5122edef87/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.501265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896bb50dc324457484da1608c39fd871, user_id=4c9a3d3b6a874b2bb66eed5122edef87, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.503966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.516758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1329/2694] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:47 2022] PUT /identity/v3/projects/896bb50dc324457484da1608c39fd871/users/4c9a3d3b6a874b2bb66eed5122edef87/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:47.526592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.526887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.527156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.556788 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] MFA Rules not processed for user `4c9a3d3b6a874b2bb66eed5122edef87`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:47.557984 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:47.630696 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1366/2695] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:47.642555 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:47.673944 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:47.701288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce25482-1df6-4342-a5e1-b8645944b862 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:47.706257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116101da-5733-46b5-8458-48b25ed3680b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:47.706918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116101da-5733-46b5-8458-48b25ed3680b service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:47.707185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116101da-5733-46b5-8458-48b25ed3680b service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:47.707466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116101da-5733-46b5-8458-48b25ed3680b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:47.770638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116101da-5733-46b5-8458-48b25ed3680b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:47.772014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116101da-5733-46b5-8458-48b25ed3680b service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:47.781072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1330/2696] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:51.356425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:51.358952 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:51.440892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e14070-60fb-4bf3-a7f2-5083eb172060 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:51.445671 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:51.446308 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:51.446583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:51.446976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] PATH_INFO: `/v3/users/53481815e510405a8bb19a9635e00038` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:51.448216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53481815e510405a8bb19a9635e00038)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:51.450258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:51.452785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:51.504529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53481815e510405a8bb19a9635e00038'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:51.507454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53481815e510405a8bb19a9635e00038'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:51.518453 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53481815e510405a8bb19a9635e00038'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:51.536793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53481815e510405a8bb19a9635e00038'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:51.550828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53481815e510405a8bb19a9635e00038'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:51.561863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1367/2697] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:51 2022] DELETE /identity/v3/users/53481815e510405a8bb19a9635e00038 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:51.570161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:51.571068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:51.571068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:51.594135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:51.595459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:51.664145 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1331/2698] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:51.676022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:51.678322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:51.776065 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acbc3-b849-4342-b17a-d3ab267561d1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:51.780132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:51.780794 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:51.781067 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:51.781336 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:51.792524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:51.794022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:51.804951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1368/2699] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:52.123993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.125629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:52.139012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d88882-c0ff-481a-996a-7d48392347d6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.144207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.144964 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.145311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.145654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] PATH_INFO: `/v3/projects/fbc9d83462584ccb802360a17518bec2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.147035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc9d83462584ccb802360a17518bec2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.149070 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.159438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.161673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:52.215228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc9d83462584ccb802360a17518bec2', 'request_id': 'req-beeab56d-5366-44ff-a4d7-e1ec309a4d62'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:52.222258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc9d83462584ccb802360a17518bec2', 'request_id': 'req-beeab56d-5366-44ff-a4d7-e1ec309a4d62'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:52.229262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc9d83462584ccb802360a17518bec2', 'request_id': 'req-beeab56d-5366-44ff-a4d7-e1ec309a4d62'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:52.229534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44fc3f-f0cd-4a5f-9e8f-7d33eb3db6df service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.245607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] The token cache is being invalidate because project fbc9d83462584ccb802360a17518bec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:52.245927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:52.246545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-beeab56d-5366-44ff-a4d7-e1ec309a4d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:52.248235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1332/2700] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:52 2022] DELETE /identity/v3/projects/fbc9d83462584ccb802360a17518bec2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:52.253659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc0537-5a73-482d-82bd-96cfc2dce8fc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.253988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc0537-5a73-482d-82bd-96cfc2dce8fc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.254308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc0537-5a73-482d-82bd-96cfc2dce8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.263663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:52.279030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:52.279594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-94fc0537-5a73-482d-82bd-96cfc2dce8fc None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:52.282984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-94fc0537-5a73-482d-82bd-96cfc2dce8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:52.295393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.296131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.296604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.297051 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.299129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:52.348830 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1333/2701] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:52.356900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.357163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.357440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.365251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.366753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.377856 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1369/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:52.380760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:52.381981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:52.389997 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1334/2703] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:52.394825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.405468 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5159b3-1f18-46dc-a643-47a06ec2bb41 service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.410586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.411207 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.411481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.411753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.412451 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:52.412727 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.414344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.426679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1370/2704] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:32:52.431194 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.441651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed46dd2-4208-4a93-90d4-8daa1ff12d71 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.447618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.448230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.448518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.448827 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.449482 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.451441 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.482099 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1335/2705] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:52.486991 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.498226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653dfe0-d8b4-4cde-87f2-105c98e065cf admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.566091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.567192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.567719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.568166 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.569325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.572869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.608459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1371/2706] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:52 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:32:52.613060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.629140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0f4b-6b70-4700-b080-82abc63cbedd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.637551 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.638682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.639343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.640017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.642109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.645200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.663700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1336/2707] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:52.665356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.684962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9c12-d4e5-4961-a771-1881c2616432 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.692672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1a477-1924-4334-b6ae-6f0e3b469f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.693128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a477-1924-4334-b6ae-6f0e3b469f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.693442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a477-1924-4334-b6ae-6f0e3b469f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.693774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1a477-1924-4334-b6ae-6f0e3b469f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.694452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1a477-1924-4334-b6ae-6f0e3b469f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.696545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1a477-1924-4334-b6ae-6f0e3b469f40 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.712113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1372/2708] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:52.716088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:52.730364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11da84-50cc-46b2-95c0-6681ec0d1fd4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:52.736280 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:52.737139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.737470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.737843 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] PATH_INFO: `/v3/projects/1edd9c360a634f65b479fc41cc921e6b/users/dbe5bbda096d4229bb7278e4b039e2d6/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.768571 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1edd9c360a634f65b479fc41cc921e6b, user_id=dbe5bbda096d4229bb7278e4b039e2d6, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:52.777701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:52.802416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1337/2709] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:52 2022] PUT /identity/v3/projects/1edd9c360a634f65b479fc41cc921e6b/users/dbe5bbda096d4229bb7278e4b039e2d6/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:52.879447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:52.879726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:52.879978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:52.914173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] MFA Rules not processed for user `dbe5bbda096d4229bb7278e4b039e2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:52.915645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:52.979082 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:53.016062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1373/2710] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:53.021638 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.112377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8daed-8345-4db7-b18e-f3cd165d6364 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.120274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.121044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.121376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.121866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.122906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.125483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.182346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1338/2711] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:53 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:53.183707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.198162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e94ab-5539-4ee8-8711-889bc79cd3bf None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.268798 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.269417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.269686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.269946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.270604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.272509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.296393 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1374/2712] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:53 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:53.301232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.312293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92db6-9026-4303-accb-1c97aa7bafa3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.318360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.318977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.319251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.319522 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.320167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.321820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.338087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1339/2713] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:53.342518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.354560 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f760a-ccba-46bd-8a6f-c63ddc22182f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.360368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e56ab-f75b-4340-a957-c08dfa817619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.361141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e56ab-f75b-4340-a957-c08dfa817619 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.361417 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e56ab-f75b-4340-a957-c08dfa817619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.361675 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e56ab-f75b-4340-a957-c08dfa817619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.362321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e56ab-f75b-4340-a957-c08dfa817619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.363938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e56ab-f75b-4340-a957-c08dfa817619 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.375793 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1375/2714] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:53.380535 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.393143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e10e3-c5b5-4c19-8aba-de450ecfc330 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.399433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.400138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.400413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.400714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] PATH_INFO: `/v3/projects/b1b773250d14414780c4a03c32bfa010/users/4d0fa4534d414e97b6e40f5292dda1af/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.416581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:53.420117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b773250d14414780c4a03c32bfa010, user_id=4d0fa4534d414e97b6e40f5292dda1af, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.423980 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.439383 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1340/2715] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:53 2022] PUT /identity/v3/projects/b1b773250d14414780c4a03c32bfa010/users/4d0fa4534d414e97b6e40f5292dda1af/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:53.450615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.450884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.451223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.485919 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] MFA Rules not processed for user `4d0fa4534d414e97b6e40f5292dda1af`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:53.487217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:53.557869 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1376/2716] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:53.563304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.633033 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcdd88-2fc6-487b-8b53-cf236c8966f8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.640031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.640689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.640988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.641272 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.642208 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.643947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.674928 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1341/2717] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:53 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:53.679380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.690855 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979b01-c92c-430b-9bb9-c9f976d728f6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.743639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:53.754134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.754756 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.755025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.755285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.755921 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.757901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.786394 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1377/2718] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:53 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:53.790435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.803196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c5b2e-6197-4ace-8d3e-95599569bc9f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.808833 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.809471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.809762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.810023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.810806 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.812294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.828137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1342/2719] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:53.832438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.843750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0529-8ae4-4779-8275-fe388745077f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.849058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.849803 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.850072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.850338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] PATH_INFO: `/v3/projects/79cac7e9cda9480db170fbdd595457c2/users/34248b7322a749adbb2895676b138778/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.873072 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cac7e9cda9480db170fbdd595457c2, user_id=34248b7322a749adbb2895676b138778, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.877962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:53.897098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1378/2720] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:53 2022] PUT /identity/v3/projects/79cac7e9cda9480db170fbdd595457c2/users/34248b7322a749adbb2895676b138778/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:53.902396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:53.914318 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3e73b-f66b-4d6f-bebe-398bed4456db admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:53.986361 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e3dc6-6112-459f-8757-f26a4880cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:53.987018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3dc6-6112-459f-8757-f26a4880cf49 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:53.987291 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3dc6-6112-459f-8757-f26a4880cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:53.987568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3dc6-6112-459f-8757-f26a4880cf49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:53.988245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e3dc6-6112-459f-8757-f26a4880cf49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:53.989903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e3dc6-6112-459f-8757-f26a4880cf49 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:54.014484 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1343/2721] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:54.016456 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:54.029363 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732897-50ad-4097-85d7-3c0e668b4e7d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:54.034884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:54.035558 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:54.035828 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:54.036108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] PATH_INFO: `/v3/projects/79cac7e9cda9480db170fbdd595457c2/users/34248b7322a749adbb2895676b138778/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:54.038229 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cac7e9cda9480db170fbdd595457c2, user_id=34248b7322a749adbb2895676b138778, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:54.041007 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:54.055672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1379/2722] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:54 2022] PUT /identity/v3/projects/79cac7e9cda9480db170fbdd595457c2/users/34248b7322a749adbb2895676b138778/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:54.067698 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:54.068087 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:54.068661 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:54.108475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] MFA Rules not processed for user `34248b7322a749adbb2895676b138778`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:54.109768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:54.169413 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:54.202342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1344/2723] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:54.216091 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:54.218559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:54.291593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20729895-12be-498d-838d-4001ba637a1b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:54.295390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:54.295945 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:54.296260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:54.296470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:54.395714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:54.397504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:54.409995 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1380/2724] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:56.004278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:56.017495 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690639-aaa1-4e14-8107-9e0492c2a22a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:56.022675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:56.023390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:56.023667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:56.023940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:56.090961 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:56.092948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:56.104645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1345/2725] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:56.740443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:56.752317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f373a-785b-4746-9c4f-3de90fa665ba service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:56.758370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa10e68-dc86-443a-823d-17ca3219a43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:56.759041 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa10e68-dc86-443a-823d-17ca3219a43c service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:56.759355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa10e68-dc86-443a-823d-17ca3219a43c service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:56.759665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa10e68-dc86-443a-823d-17ca3219a43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:56.770464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa10e68-dc86-443a-823d-17ca3219a43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:56.771918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa10e68-dc86-443a-823d-17ca3219a43c service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:56.782623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1381/2726] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:57.485626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:57.487281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:57.580881 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ce18-0b07-4104-8636-29df5dcb2ff0 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:57.586723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:57.587390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:57.587682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:57.587958 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] PATH_INFO: `/v3/users/e4562506ce9b4a74bf45af01ecb12e59` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:57.589243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4562506ce9b4a74bf45af01ecb12e59)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:57.591236 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:57.651364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4562506ce9b4a74bf45af01ecb12e59'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:57.661743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4562506ce9b4a74bf45af01ecb12e59'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:57.662629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4562506ce9b4a74bf45af01ecb12e59'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:57.678329 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4562506ce9b4a74bf45af01ecb12e59'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:57.687419 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4562506ce9b4a74bf45af01ecb12e59'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:57.695623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1346/2727] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:57 2022] DELETE /identity/v3/users/e4562506ce9b4a74bf45af01ecb12e59 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:57.700602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:57.700917 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:57.701194 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:57.723422 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:57.724683 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:57.785197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:57.809462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1382/2728] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:57.822462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:57.823945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:57.831705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:57.895636 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2ec7c-d63b-459a-97b1-5f2b229119b8 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:57.899727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:57.901002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:57.901290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:57.901607 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:57.913647 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:57.915117 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:57.934047 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1347/2729] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:32:58.316531 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:58.322941 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:58.388981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c943ef-8952-493b-aa18-4f36dfc27742 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:58.396242 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:58.397445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:58.398032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:58.398574 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] PATH_INFO: `/v3/projects/725b2f070de14e93b2d4b299046c9c12` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:58.401158 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=725b2f070de14e93b2d4b299046c9c12)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:58.405031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:58.509854 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725b2f070de14e93b2d4b299046c9c12', 'request_id': 'req-c126bbce-56fd-4077-a045-b152936bce44'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.518523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725b2f070de14e93b2d4b299046c9c12', 'request_id': 'req-c126bbce-56fd-4077-a045-b152936bce44'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.534930 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725b2f070de14e93b2d4b299046c9c12', 'request_id': 'req-c126bbce-56fd-4077-a045-b152936bce44'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.549974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] The token cache is being invalidate because project 725b2f070de14e93b2d4b299046c9c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:58.550292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.551152 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.552918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1383/2730] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:58 2022] DELETE /identity/v3/projects/725b2f070de14e93b2d4b299046c9c12 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:58.558572 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:58.569966 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238148d-6c42-402c-8115-8199472eb25d service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:58.649583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:58.650330 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:58.650679 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:58.650977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] PATH_INFO: `/v3/users/4c9a3d3b6a874b2bb66eed5122edef87` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:58.653113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9a3d3b6a874b2bb66eed5122edef87)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:58.656693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:58.737344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9a3d3b6a874b2bb66eed5122edef87'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.753062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9a3d3b6a874b2bb66eed5122edef87'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.753927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9a3d3b6a874b2bb66eed5122edef87'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.774545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9a3d3b6a874b2bb66eed5122edef87'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.791759 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-cdf7ebe2-b29e-4400-86f1-8c201990b453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9a3d3b6a874b2bb66eed5122edef87'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:58.805133 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1348/2731] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:32:58 2022] DELETE /identity/v3/users/4c9a3d3b6a874b2bb66eed5122edef87 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:32:59.129672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.132162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:59.148709 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126bbce-56fd-4077-a045-b152936bce44 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.223871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.224441 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.224861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.225132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] PATH_INFO: `/v3/projects/896bb50dc324457484da1608c39fd871` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.226285 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] RBAC: Authorizing `identity:delete_project(project_id=896bb50dc324457484da1608c39fd871)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.228196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.284519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896bb50dc324457484da1608c39fd871', 'request_id': 'req-fb3fba5b-6a3e-4342-9321-c473e6d1001d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:59.291420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896bb50dc324457484da1608c39fd871', 'request_id': 'req-fb3fba5b-6a3e-4342-9321-c473e6d1001d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:59.300044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896bb50dc324457484da1608c39fd871', 'request_id': 'req-fb3fba5b-6a3e-4342-9321-c473e6d1001d'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:59.308425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:59.312951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] The token cache is being invalidate because project 896bb50dc324457484da1608c39fd871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:32:59.313517 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:59.314667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-fb3fba5b-6a3e-4342-9321-c473e6d1001d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:32:59.316284 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1384/2732] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:32:59 2022] DELETE /identity/v3/projects/896bb50dc324457484da1608c39fd871 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:32:59.322624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.322992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.323453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.344685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:59.345932 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:59.371077 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:59.440925 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1349/2733] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:32:59.451460 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.451971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.452356 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.478222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:32:59.479367 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:32:59.487850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1385/2734] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:32:59.493104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.504478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e458f-20b5-48be-b04e-485cd6cf24b6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.513793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.514681 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.515254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.515580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.516541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:32:59.517198 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.519068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.536017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1350/2735] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:32:59.542145 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.554717 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f24a1a-e43d-45c3-9d9a-8adfee4e1f7e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.561620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.562320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.562653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.562987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.563983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.566135 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.631000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1386/2736] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:32:59 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:59.637246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.657675 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0f148-d304-4b81-8d32-6f25e0337f04 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.750755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.751475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.751819 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.752095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.752815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.754842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.790775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1351/2737] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:32:59 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:32:59.791382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.805424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802443d8-1a28-49e3-a764-9c887ea76155 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.811124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.812006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.812161 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.812424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.814167 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.815737 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.829294 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1387/2738] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:32:59.840420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.855876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aeb4b-ea10-4c13-9641-e1f840786a81 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.863239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30a0cb-7852-4286-9df9-4c28e7b4a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.864192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30a0cb-7852-4286-9df9-4c28e7b4a759 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.864967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30a0cb-7852-4286-9df9-4c28e7b4a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.865126 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30a0cb-7852-4286-9df9-4c28e7b4a759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.866390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30a0cb-7852-4286-9df9-4c28e7b4a759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.869676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30a0cb-7852-4286-9df9-4c28e7b4a759 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.891012 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1352/2739] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:32:59.900142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:32:59.915203 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8253a4-d2d0-48cb-892c-10982995f21e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:32:59.933781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:32:59.934552 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:32:59.935027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:32:59.935355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] PATH_INFO: `/v3/projects/88c778da8fae4432b3607c162df8017a/users/147ccfe54faf45d1b76b0b240bf8a11d/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:32:59.959444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c778da8fae4432b3607c162df8017a, user_id=147ccfe54faf45d1b76b0b240bf8a11d, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:32:59.963606 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:32:59.989999 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1388/2740] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:32:59 2022] PUT /identity/v3/projects/88c778da8fae4432b3607c162df8017a/users/147ccfe54faf45d1b76b0b240bf8a11d/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:00.102593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.103045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.103536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.146578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] MFA Rules not processed for user `147ccfe54faf45d1b76b0b240bf8a11d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:00.148861 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:00.262284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1353/2741] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:00.274745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:00.392825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135146e-54e4-434d-900a-ddf6b353ee3c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:00.399649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:00.400401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.400776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.401116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.402951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:00.403948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:00.449488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1389/2742] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:00 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:00.455785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:00.471772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b3d7c-c0a9-4f9a-a670-5e618a7c81d5 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:00.500106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:00.573447 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:00.577987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.578625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.580112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.581409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:00.585666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:00.620040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1354/2743] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:00 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:00.624820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:00.637390 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838438a-867d-4305-a8c2-0492a943dd8c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:00.643772 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:00.644436 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.644731 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.644996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.645662 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:00.647306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:00.662240 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1390/2744] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:00.667994 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:00.685375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd347a6-b4a0-4de2-b7f8-e47211f973d2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:00.694247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5f2f5-4252-4fce-8c35-e92645cafba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:00.695310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f2f5-4252-4fce-8c35-e92645cafba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.695796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f2f5-4252-4fce-8c35-e92645cafba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.696292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f2f5-4252-4fce-8c35-e92645cafba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.697465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5f2f5-4252-4fce-8c35-e92645cafba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:00.700293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5f2f5-4252-4fce-8c35-e92645cafba9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:00.723657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1355/2745] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:00.725748 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:00.739649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7af0-1498-467e-851a-7ea8ccaea37e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:00.746973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:00.747667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.747951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.748222 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] PATH_INFO: `/v3/projects/fa7d7b0958b3473c9b878c62d91f494f/users/9f6fc1d82d8f4175902b1f1f6c5739cf/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.772892 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7d7b0958b3473c9b878c62d91f494f, user_id=9f6fc1d82d8f4175902b1f1f6c5739cf, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:00.778231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:00.803089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1391/2746] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:00 2022] PUT /identity/v3/projects/fa7d7b0958b3473c9b878c62d91f494f/users/9f6fc1d82d8f4175902b1f1f6c5739cf/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:00.813911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:00.814186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:00.814525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:00.850662 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] MFA Rules not processed for user `9f6fc1d82d8f4175902b1f1f6c5739cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:00.852172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:00.930328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1356/2747] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:00.935287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.002897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:01.026062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0475d6-5960-44a3-9180-0d044705463b admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.037670 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.038568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.039013 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.039413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.040298 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.043391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.046261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.048181 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.068021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6580-1e7a-483c-8657-aecb13ab93f6 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.074264 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.075008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.075343 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.075676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] PATH_INFO: `/v3/users/dbe5bbda096d4229bb7278e4b039e2d6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.077192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe5bbda096d4229bb7278e4b039e2d6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.079609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.096134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1392/2748] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:00 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:01.100716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.148542 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe5bbda096d4229bb7278e4b039e2d6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:01.160578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe5bbda096d4229bb7278e4b039e2d6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:01.162870 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe5bbda096d4229bb7278e4b039e2d6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:01.185111 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54bf1-7c5c-4462-b3b1-f7b1baa9219a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.185968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe5bbda096d4229bb7278e4b039e2d6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:01.191615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.192344 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.192800 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.193263 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.194151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.197355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.199853 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f1e636ad-b9c6-4e9c-8b91-47ba0b029edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe5bbda096d4229bb7278e4b039e2d6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:01.211319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1357/2749] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:01 2022] DELETE /identity/v3/users/dbe5bbda096d4229bb7278e4b039e2d6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:01.217560 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.218008 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.218618 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.232139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:01.232975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1393/2750] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:01 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:01.237899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.240608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.250612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:01.252712 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.263341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b5a30-73b4-4575-b67d-4f20f3a27214 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.340663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1358/2751] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:01.351861 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.352790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.353142 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.353571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.354069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.354623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.356231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.357526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.380937 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1394/2752] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:01.382548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.395956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef367a2c-4dce-46b5-b31b-68f600960030 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.402085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.402784 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.403056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.403324 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] PATH_INFO: `/v3/projects/bdc169214d704f299a1d71a67456a229/users/8ddcf5affb9b481ead7235f615c3ce5d/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.421610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc169214d704f299a1d71a67456a229, user_id=8ddcf5affb9b481ead7235f615c3ce5d, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.425159 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.441886 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd426b-c7dd-4d16-8d9c-093c73d17bc7 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.444648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1395/2753] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:01 2022] PUT /identity/v3/projects/bdc169214d704f299a1d71a67456a229/users/8ddcf5affb9b481ead7235f615c3ce5d/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:01.450293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.495933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:01.518717 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.519626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.520063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.520506 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.531745 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ad6d4-fcea-4805-970a-0074ff9637a9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.535204 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.537554 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.537825 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3948-2aea-4dcf-9bee-5387b11fa3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.538527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3948-2aea-4dcf-9bee-5387b11fa3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.538858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3948-2aea-4dcf-9bee-5387b11fa3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.539266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3948-2aea-4dcf-9bee-5387b11fa3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.539983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3948-2aea-4dcf-9bee-5387b11fa3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.541969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3948-2aea-4dcf-9bee-5387b11fa3f8 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.553128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1359/2754] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:01.555987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1396/2755] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:01.560537 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.575188 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273dc8-459f-48a1-8144-2c987fe69e24 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.583508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.584378 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.584770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.585167 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] PATH_INFO: `/v3/projects/bdc169214d704f299a1d71a67456a229/users/8ddcf5affb9b481ead7235f615c3ce5d/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.588205 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc169214d704f299a1d71a67456a229, user_id=8ddcf5affb9b481ead7235f615c3ce5d, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:01.592720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:01.614987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1360/2756] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:01 2022] PUT /identity/v3/projects/bdc169214d704f299a1d71a67456a229/users/8ddcf5affb9b481ead7235f615c3ce5d/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:01.629471 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.629920 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.630387 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.701796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] MFA Rules not processed for user `8ddcf5affb9b481ead7235f615c3ce5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:01.704046 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.844248 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1397/2757] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:01.860933 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.863172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.946309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:01.955760 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a2e3-283f-4ad2-8adf-d80b18c9ebd9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:01.964363 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:01.965182 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:01.965644 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:01.966179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:01.966707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:01.966834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:01.970669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:02.073709 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:02.075172 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:02.076766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b519e6-8eab-43dd-885e-79d5d8d549a6 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:02.085775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1361/2758] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:02.086001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:02.088433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:02.089148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:02.089619 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] PATH_INFO: `/v3/projects/1edd9c360a634f65b479fc41cc921e6b` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:02.091491 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1edd9c360a634f65b479fc41cc921e6b)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:02.093902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:02.150202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1edd9c360a634f65b479fc41cc921e6b', 'request_id': 'req-4953b484-23a8-4b4a-8d77-b1be7df62dda'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.157428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1edd9c360a634f65b479fc41cc921e6b', 'request_id': 'req-4953b484-23a8-4b4a-8d77-b1be7df62dda'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.160325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:02.169291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1edd9c360a634f65b479fc41cc921e6b', 'request_id': 'req-4953b484-23a8-4b4a-8d77-b1be7df62dda'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.189366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] The token cache is being invalidate because project 1edd9c360a634f65b479fc41cc921e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:02.189867 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.191014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.193518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1398/2759] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:01 2022] DELETE /identity/v3/projects/1edd9c360a634f65b479fc41cc921e6b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:02.199478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:02.214525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3ef0-9c4c-45d8-a45e-891d16613bf1 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:02.279223 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:02.279927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:02.280212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:02.280477 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] PATH_INFO: `/v3/users/4d0fa4534d414e97b6e40f5292dda1af` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:02.281795 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0fa4534d414e97b6e40f5292dda1af)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:02.290515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:02.349337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0fa4534d414e97b6e40f5292dda1af'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.361481 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0fa4534d414e97b6e40f5292dda1af'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.362923 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0fa4534d414e97b6e40f5292dda1af'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.382601 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0fa4534d414e97b6e40f5292dda1af'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.390894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0fa4534d414e97b6e40f5292dda1af'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.401575 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1362/2760] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:02 2022] DELETE /identity/v3/users/4d0fa4534d414e97b6e40f5292dda1af => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:02.765103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:02.767454 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:02.782611 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b484-23a8-4b4a-8d77-b1be7df62dda admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:02.863098 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:02.863897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:02.864272 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:02.864690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] PATH_INFO: `/v3/projects/b1b773250d14414780c4a03c32bfa010` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:02.866249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b773250d14414780c4a03c32bfa010)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:02.868863 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:02.935899 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b773250d14414780c4a03c32bfa010', 'request_id': 'req-481c35e5-bec4-457b-bb20-d1350776570c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.946815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b773250d14414780c4a03c32bfa010', 'request_id': 'req-481c35e5-bec4-457b-bb20-d1350776570c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.957902 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b773250d14414780c4a03c32bfa010', 'request_id': 'req-481c35e5-bec4-457b-bb20-d1350776570c'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.973297 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] The token cache is being invalidate because project b1b773250d14414780c4a03c32bfa010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:02.973579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.974413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:02.976001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1399/2761] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:02 2022] DELETE /identity/v3/projects/b1b773250d14414780c4a03c32bfa010 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:02.980420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:02.981841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:02.997941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecf14d-8adf-40b0-a194-39abbc975986 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:03.026694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:03.074451 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:03.075177 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.075453 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.075732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] PATH_INFO: `/v3/users/34248b7322a749adbb2895676b138778` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.076968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34248b7322a749adbb2895676b138778)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:03.079400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:03.131940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34248b7322a749adbb2895676b138778'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.142999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34248b7322a749adbb2895676b138778'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.143798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34248b7322a749adbb2895676b138778'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.159585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34248b7322a749adbb2895676b138778'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.168951 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-812026ab-fcfe-4a46-a31a-c84b7f5aefe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34248b7322a749adbb2895676b138778'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.175339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1363/2762] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:02 2022] DELETE /identity/v3/users/34248b7322a749adbb2895676b138778 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:03.491541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:03.498807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:03.529591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c35e5-bec4-457b-bb20-d1350776570c admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:03.594188 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:03.595258 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.595380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.595894 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] PATH_INFO: `/v3/projects/79cac7e9cda9480db170fbdd595457c2` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.597196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cac7e9cda9480db170fbdd595457c2)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:03.599105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:03.622976 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:03.668541 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cac7e9cda9480db170fbdd595457c2', 'request_id': 'req-9d2a628d-b6ad-41f9-be21-245143e28bec'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.677225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cac7e9cda9480db170fbdd595457c2', 'request_id': 'req-9d2a628d-b6ad-41f9-be21-245143e28bec'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.686594 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cac7e9cda9480db170fbdd595457c2', 'request_id': 'req-9d2a628d-b6ad-41f9-be21-245143e28bec'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.703452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] The token cache is being invalidate because project 79cac7e9cda9480db170fbdd595457c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:03.704001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.705129 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:03.707217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1400/2763] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:03 2022] DELETE /identity/v3/projects/79cac7e9cda9480db170fbdd595457c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:03.713324 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840c6af-8bc8-4e71-8057-91b98dbf4e61 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.713591 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840c6af-8bc8-4e71-8057-91b98dbf4e61 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.713889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840c6af-8bc8-4e71-8057-91b98dbf4e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.737348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-d840c6af-8bc8-4e71-8057-91b98dbf4e61 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:03.738576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-d840c6af-8bc8-4e71-8057-91b98dbf4e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:03.757026 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:03.759716 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:03.836532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a628d-b6ad-41f9-be21-245143e28bec admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:03.840597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1364/2764] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:03.846544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.846840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.847091 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.847496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:03.848333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.848838 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.849199 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.851383 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:03.870716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:03.872757 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:03.888777 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1365/2765] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:03.890365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:03.900754 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9019-2e93-47cb-bcf1-94dce00260f4 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:03.906028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:03.906722 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.907856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.908207 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.908909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:33:03.909217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:03.910855 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:03.924325 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1366/2766] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:33:03.928553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:03.940777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:03.941127 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9e1a-744f-49b4-9f86-ac7dcefd5f33 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:03.942269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:03.946841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:03.947472 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:03.947755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:03.948028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:03.948701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:03.950635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:03.952094 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1401/2767] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:03.978401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:03.987768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1367/2768] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:03 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:03.991721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:04.004245 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b24b5-75f0-45a8-ba12-2b468216d40f service cinder] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:04.089269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:04.089610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.089884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.090292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.090799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:04.092723 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:04.103113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:04.128358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1402/2769] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:03 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:04.128574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:04.138685 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc584-9985-4911-b307-c42f2984496e admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:04.145162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:04.145789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.146146 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.146968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.147877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:04.149705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:04.166024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1368/2770] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:04.168271 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:04.180603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8516afb-6a8f-4d1a-80c7-4bab0327b093 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:04.185689 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136be11c-1427-4e7b-8173-1d2857cdea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:04.186311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be11c-1427-4e7b-8173-1d2857cdea7b admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.186587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be11c-1427-4e7b-8173-1d2857cdea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.186857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136be11c-1427-4e7b-8173-1d2857cdea7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.187504 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136be11c-1427-4e7b-8173-1d2857cdea7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:04.189268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136be11c-1427-4e7b-8173-1d2857cdea7b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:04.206631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1403/2771] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:04.206876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:04.215659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c696cef-7920-4c9e-9552-182847b8f149 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:04.221284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:04.221955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.222235 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.222512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] PATH_INFO: `/v3/projects/9eb7672959d6462bafedb25f94d04b05/users/4d7c50ecfb3740b5a729192be04fbd2f/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.239497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb7672959d6462bafedb25f94d04b05, user_id=4d7c50ecfb3740b5a729192be04fbd2f, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:04.243241 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:04.260185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1369/2772] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:04 2022] PUT /identity/v3/projects/9eb7672959d6462bafedb25f94d04b05/users/4d7c50ecfb3740b5a729192be04fbd2f/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:04.264973 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.265311 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.265564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.287688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:04.289395 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:04.352139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1404/2773] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:04.362384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:04.364165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:04.426776 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f3f93-fdc8-419c-9546-9c7c80b46102 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:04.430358 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:04.430975 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.431393 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.431673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.442278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:04.444354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:04.455387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1370/2774] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:04.612522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:04.674407 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656621fb-955a-4c24-b0c2-71a7d64afeb7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:04.678341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:04.678922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:04.679202 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:04.679488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:04.681871 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:04.753204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:04.754806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f72c37-f533-4d57-a044-316f77940731 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:04.766292 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1405/2775] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:09.121345 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:09.124258 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:09.145311 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c812a-dffa-43d2-b5c3-80b9cce3595b service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:09.151259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:09.152023 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:09.152702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:09.153224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] PATH_INFO: `/v3/users/147ccfe54faf45d1b76b0b240bf8a11d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:09.154798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147ccfe54faf45d1b76b0b240bf8a11d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:09.157279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:09.305171 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147ccfe54faf45d1b76b0b240bf8a11d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:09.324342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147ccfe54faf45d1b76b0b240bf8a11d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:09.325128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147ccfe54faf45d1b76b0b240bf8a11d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:09.342290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147ccfe54faf45d1b76b0b240bf8a11d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:09.356112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147ccfe54faf45d1b76b0b240bf8a11d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:09.366762 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1371/2776] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:09 2022] DELETE /identity/v3/users/147ccfe54faf45d1b76b0b240bf8a11d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:09.373190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd430e9e-62ad-44c6-98b4-c51e22ce0f16 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:09.374628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd430e9e-62ad-44c6-98b4-c51e22ce0f16 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:09.375428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd430e9e-62ad-44c6-98b4-c51e22ce0f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:09.418256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bd430e9e-62ad-44c6-98b4-c51e22ce0f16 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:09.420319 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bd430e9e-62ad-44c6-98b4-c51e22ce0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:09.478171 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:09.560175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1406/2777] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:09.572397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:09.573953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:09.667849 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:09.704247 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f939a1-3062-4fac-a49b-d4570e95ec82 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:09.713743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:09.714800 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:09.715288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:09.715859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:09.733216 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:09.736131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:09.774211 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1372/2778] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:10.096669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.097002 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.097470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.177896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] MFA Rules not processed for user `4d7c50ecfb3740b5a729192be04fbd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:10.178927 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:10.276326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.279341 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:10.302200 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7ce9-5cba-42b2-8366-139245f6793d service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:10.309609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:10.310262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.310546 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.310823 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] PATH_INFO: `/v3/projects/88c778da8fae4432b3607c162df8017a` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.312531 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c778da8fae4432b3607c162df8017a)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:10.314388 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:10.347775 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1407/2779] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:10.352434 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.357593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:10.389617 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f7453-fec5-4738-8d1f-ccd3791f8a6c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:10.397494 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:10.398107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.398439 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.398712 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.399379 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:10.409947 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:10.429718 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c778da8fae4432b3607c162df8017a', 'request_id': 'req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.445866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c778da8fae4432b3607c162df8017a', 'request_id': 'req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.459013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c778da8fae4432b3607c162df8017a', 'request_id': 'req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.465444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1408/2780] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:10 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:10.474722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.490632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] The token cache is being invalidate because project 88c778da8fae4432b3607c162df8017a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:10.490632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.490632 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.493579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1373/2781] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:10 2022] DELETE /identity/v3/projects/88c778da8fae4432b3607c162df8017a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:10.497945 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.499931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:10.560601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea72b60-f434-417d-ab06-6c9a54e985b3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:10.569897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:10.571287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.571769 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.573568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.573568 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:10.576535 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:10.612716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191d1e-c3e9-430e-ac0d-2dc396b5c410 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:10.614672 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1409/2782] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:10 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:10.619496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.620768 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:10.621398 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.621676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.621957 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] PATH_INFO: `/v3/users/9f6fc1d82d8f4175902b1f1f6c5739cf` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.622914 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:10.623887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6fc1d82d8f4175902b1f1f6c5739cf)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:10.626391 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:10.638658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047025-cabb-4bda-8b6f-ed3fc25129f1 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:10.644830 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:10.645485 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.645659 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.646062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.653983 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:10.655730 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:10.676237 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1410/2783] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:10.681534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.693889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d74e3-ef54-4f2b-bcdd-26675005ba2e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:10.698192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6fc1d82d8f4175902b1f1f6c5739cf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.703006 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:10.706219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:10.706859 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:10.707402 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] PATH_INFO: `/v3/projects/7f3ced38a8744f84baed36158fd313b3/users/2142df78b3234475b092d3ac318fc7b2/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:10.710931 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6fc1d82d8f4175902b1f1f6c5739cf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.711804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6fc1d82d8f4175902b1f1f6c5739cf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.725072 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:10.727655 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6fc1d82d8f4175902b1f1f6c5739cf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.728035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:10.733836 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3ced38a8744f84baed36158fd313b3, user_id=2142df78b3234475b092d3ac318fc7b2, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:10.738032 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6fc1d82d8f4175902b1f1f6c5739cf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:10.738273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:10.745230 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1374/2784] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:10 2022] DELETE /identity/v3/users/9f6fc1d82d8f4175902b1f1f6c5739cf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:10.756948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1411/2785] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:10 2022] PUT /identity/v3/projects/7f3ced38a8744f84baed36158fd313b3/users/2142df78b3234475b092d3ac318fc7b2/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:10.762652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:10.764232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:11.068822 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1709b25-a9e5-4188-9a2f-505fd87450f3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:11.151442 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:11.153137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:11.153810 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:11.154286 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:11.155219 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:11.158497 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:11.163586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:11.166224 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:11.190539 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1375/2786] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:11.198772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:11.199878 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1046-54cb-4cde-a2d0-0e2fa672561e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:11.206343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:11.208323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:11.208323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:11.208323 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] PATH_INFO: `/v3/projects/fa7d7b0958b3473c9b878c62d91f494f` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:11.209523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7d7b0958b3473c9b878c62d91f494f)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:11.211636 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:11.218817 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea7173-b654-40e8-b40f-23a19c53b26c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:11.229959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:11.231884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:11.232370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:11.232876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] PATH_INFO: `/v3/projects/7f3ced38a8744f84baed36158fd313b3/users/2142df78b3234475b092d3ac318fc7b2/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:11.236831 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3ced38a8744f84baed36158fd313b3, user_id=2142df78b3234475b092d3ac318fc7b2, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:11.239916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:11.259674 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1376/2787] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:11 2022] PUT /identity/v3/projects/7f3ced38a8744f84baed36158fd313b3/users/2142df78b3234475b092d3ac318fc7b2/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:11.323691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7d7b0958b3473c9b878c62d91f494f', 'request_id': 'req-dba9668f-01fc-447d-bfc7-7246413551f5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.351806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7d7b0958b3473c9b878c62d91f494f', 'request_id': 'req-dba9668f-01fc-447d-bfc7-7246413551f5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.376593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7d7b0958b3473c9b878c62d91f494f', 'request_id': 'req-dba9668f-01fc-447d-bfc7-7246413551f5'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.390177 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] The token cache is being invalidate because project fa7d7b0958b3473c9b878c62d91f494f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:11.391889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.391889 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.394381 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1412/2788] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:11 2022] DELETE /identity/v3/projects/fa7d7b0958b3473c9b878c62d91f494f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:11.399684 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:11.403682 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:11.583115 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998de0b-333b-40e8-8d66-478964e11a1a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:11.640519 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:11.724968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:11.726669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:11.727249 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:11.727688 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] PATH_INFO: `/v3/users/8ddcf5affb9b481ead7235f615c3ce5d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:11.730758 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddcf5affb9b481ead7235f615c3ce5d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:11.735523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:11.821294 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddcf5affb9b481ead7235f615c3ce5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.833748 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddcf5affb9b481ead7235f615c3ce5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.834517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddcf5affb9b481ead7235f615c3ce5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.864743 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddcf5affb9b481ead7235f615c3ce5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.880802 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-87d01c52-3934-4acb-8253-27393cdac14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddcf5affb9b481ead7235f615c3ce5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:11.893832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1377/2789] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:11 2022] DELETE /identity/v3/users/8ddcf5affb9b481ead7235f615c3ce5d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:12.269210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:12.284334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9668f-01fc-447d-bfc7-7246413551f5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:12.359936 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:12.361343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:12.361343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:12.361343 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] PATH_INFO: `/v3/projects/bdc169214d704f299a1d71a67456a229` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:12.362564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc169214d704f299a1d71a67456a229)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:12.364663 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:12.424420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc169214d704f299a1d71a67456a229', 'request_id': 'req-df2bd942-1cbf-43d1-92a8-0791c3f7a044'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:12.436259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc169214d704f299a1d71a67456a229', 'request_id': 'req-df2bd942-1cbf-43d1-92a8-0791c3f7a044'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:12.447527 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc169214d704f299a1d71a67456a229', 'request_id': 'req-df2bd942-1cbf-43d1-92a8-0791c3f7a044'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:12.464295 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] The token cache is being invalidate because project bdc169214d704f299a1d71a67456a229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:12.464701 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:12.469039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-df2bd942-1cbf-43d1-92a8-0791c3f7a044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:12.474721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1413/2790] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:12 2022] DELETE /identity/v3/projects/bdc169214d704f299a1d71a67456a229 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:12.481942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:12.482639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:12.482639 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:12.509988 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:12.512201 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:12.604006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1378/2791] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:12.614058 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:12.615385 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:12.616236 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:12.635106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:12.659318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:12.661839 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:12.679967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1414/2792] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:12.681598 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:12.694912 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602201e-ec31-4219-8e8e-2be6b7c5593a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:12.701657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:12.703212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:12.703212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:12.703212 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:12.705319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:33:12.705781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:12.707640 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:12.730693 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:12.734544 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1379/2793] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:33:12.753627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f3f1-c74a-49a9-9747-5a0889a17f60 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:12.761192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:12.762017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:12.762627 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:12.762771 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:12.763757 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:12.767196 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:12.827554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1415/2794] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:12 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:12.831626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:12.843713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bae978-9cdf-4a52-bd81-6f7ab372ec74 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:12.888332 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:12.949902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:12.950783 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:12.951140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:12.951623 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:12.953309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:12.959111 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:13.007178 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1380/2795] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:12 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:13.013259 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:13.038261 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1f31-5f5f-4a05-8422-eed1585bf48a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:13.044728 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:13.045466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:13.045959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:13.046231 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:13.047107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:13.049707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:13.070898 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1416/2796] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:13.073466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:13.099206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8a13b-b7b4-4159-8e65-7f401c6fb1e7 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:13.107664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8daed2-173e-468e-be1f-16397e797ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:13.108858 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daed2-173e-468e-be1f-16397e797ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:13.109403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daed2-173e-468e-be1f-16397e797ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:13.111060 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daed2-173e-468e-be1f-16397e797ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:13.112340 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daed2-173e-468e-be1f-16397e797ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:13.114405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daed2-173e-468e-be1f-16397e797ae2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:13.140909 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1381/2797] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:13.142978 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:13.166333 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f061e-74a1-4ad0-8e3c-3f856b653ddf admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:13.177376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:13.179267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:13.180232 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:13.180818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] PATH_INFO: `/v3/projects/7f3179ec302246e7a31ed96371f03c6f/users/79b54c0102e146c495349606fa931dac/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:13.220143 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3179ec302246e7a31ed96371f03c6f, user_id=79b54c0102e146c495349606fa931dac, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:13.226482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:13.286040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1417/2798] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:13 2022] PUT /identity/v3/projects/7f3179ec302246e7a31ed96371f03c6f/users/79b54c0102e146c495349606fa931dac/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:13.298293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171535a-608a-4c51-a497-16e77f618bd2 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:13.300863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171535a-608a-4c51-a497-16e77f618bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:13.302079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171535a-608a-4c51-a497-16e77f618bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:13.413055 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f171535a-608a-4c51-a497-16e77f618bd2 None None] MFA Rules not processed for user `79b54c0102e146c495349606fa931dac`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:13.419523 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f171535a-608a-4c51-a497-16e77f618bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:13.586470 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1382/2799] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:13.607987 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:13.610997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:13.733998 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a673c-7acd-4373-a15e-09091194b4be admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:13.739845 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a847910274f346d5b0320b725599b14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:13.740862 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:13.741329 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:13.741726 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:13.760860 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:13.762764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:13.783023 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1418/2800] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:17.290953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb2b2a-3ad7-4e09-a6fd-c46b1fdcefce None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:17.292050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb2b2a-3ad7-4e09-a6fd-c46b1fdcefce None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:17.292559 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb2b2a-3ad7-4e09-a6fd-c46b1fdcefce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:17.326645 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-65fb2b2a-3ad7-4e09-a6fd-c46b1fdcefce None None] MFA Rules not processed for user `2142df78b3234475b092d3ac318fc7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:17.328385 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-65fb2b2a-3ad7-4e09-a6fd-c46b1fdcefce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:17.445331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1383/2801] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:17.461616 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:17.463062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:17.559256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c3e1f-f419-4dd5-a578-b7a8e52aadcb service glance] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:17.567181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:17.567834 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:17.568109 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:17.568382 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:17.570304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:17.601526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:17.663598 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:17.665291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:17.676219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1419/2802] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:19.141816 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71300d-28de-413c-ae84-c1d2193db876 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:19.142630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71300d-28de-413c-ae84-c1d2193db876 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:19.142630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71300d-28de-413c-ae84-c1d2193db876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:19.165186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-bf71300d-28de-413c-ae84-c1d2193db876 None None] MFA Rules not processed for user `4d7c50ecfb3740b5a729192be04fbd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:19.166448 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bf71300d-28de-413c-ae84-c1d2193db876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:19.174938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1384/2803] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:19.888738 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:19.890246 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:20.000961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15939-014c-42ce-8108-8e2d56a1a4e5 service nova] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:20.005548 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:20.006217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:20.006490 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:20.006759 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] PATH_INFO: `/v3/users/952ad7166454421f9336c207181563c6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:20.007901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952ad7166454421f9336c207181563c6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:20.009864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:20.082791 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952ad7166454421f9336c207181563c6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:20.089532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952ad7166454421f9336c207181563c6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:20.103807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952ad7166454421f9336c207181563c6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:20.120965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952ad7166454421f9336c207181563c6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:20.135447 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952ad7166454421f9336c207181563c6'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:20.148089 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1420/2804] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:19 2022] DELETE /identity/v3/users/952ad7166454421f9336c207181563c6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:20.150487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:20.150999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:20.151395 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:20.207986 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:20.209938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:20.240314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:20.318781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1385/2805] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:20.330235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:20.334193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:20.411099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:20.458880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78deea-7d0c-4e50-a567-7daf6a7bb310 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:20.464557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:20.464557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:20.464557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:20.464557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:20.482320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:20.482804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:20.495301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1421/2806] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:21.153700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:21.156225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:21.173068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a877d61-8015-43ac-b427-b62d8564756b None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:21.178251 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:21.178914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:21.179183 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:21.179651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] PATH_INFO: `/v3/projects/14505ba5f28e4b1fa823ad6220b73697` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:21.181229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14505ba5f28e4b1fa823ad6220b73697)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:21.183735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:21.308857 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14505ba5f28e4b1fa823ad6220b73697', 'request_id': 'req-74781784-7feb-434c-b225-a87a8ca91b5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.320432 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14505ba5f28e4b1fa823ad6220b73697', 'request_id': 'req-74781784-7feb-434c-b225-a87a8ca91b5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.335589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14505ba5f28e4b1fa823ad6220b73697', 'request_id': 'req-74781784-7feb-434c-b225-a87a8ca91b5d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.370872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] The token cache is being invalidate because project 14505ba5f28e4b1fa823ad6220b73697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:21.371337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.373269 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.378715 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1386/2807] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:21 2022] DELETE /identity/v3/projects/14505ba5f28e4b1fa823ad6220b73697 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:21.385313 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:21.403669 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a639bf-3095-49d0-be8d-776c367d3688 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:21.505864 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:21.506660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:21.506915 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:21.507201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] PATH_INFO: `/v3/users/98f804df94d94a3c94599121bf4f9611` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:21.508903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f804df94d94a3c94599121bf4f9611)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:21.510916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:21.583513 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f804df94d94a3c94599121bf4f9611'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.584273 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f804df94d94a3c94599121bf4f9611'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.595178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f804df94d94a3c94599121bf4f9611'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.614968 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f804df94d94a3c94599121bf4f9611'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.623543 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-b7e96b71-ce80-4ecb-8f0b-851d83d95cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f804df94d94a3c94599121bf4f9611'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:21.631409 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1422/2808] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:21 2022] DELETE /identity/v3/users/98f804df94d94a3c94599121bf4f9611 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:21.979720 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:21.981421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:22.002185 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74781784-7feb-434c-b225-a87a8ca91b5d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.113842 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.114840 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.115290 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.115699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] PATH_INFO: `/v3/projects/36521caf8d4c4c6cb26a65f6519db223` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.117799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36521caf8d4c4c6cb26a65f6519db223)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.120252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.183176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:22.196338 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36521caf8d4c4c6cb26a65f6519db223', 'request_id': 'req-a582e60d-f8a4-41c9-b90a-413e3354c327'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:22.209128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36521caf8d4c4c6cb26a65f6519db223', 'request_id': 'req-a582e60d-f8a4-41c9-b90a-413e3354c327'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:22.217533 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36521caf8d4c4c6cb26a65f6519db223', 'request_id': 'req-a582e60d-f8a4-41c9-b90a-413e3354c327'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:22.233143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] The token cache is being invalidate because project 36521caf8d4c4c6cb26a65f6519db223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:22.233431 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:22.234089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-a582e60d-f8a4-41c9-b90a-413e3354c327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:22.235875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1387/2809] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:21 2022] DELETE /identity/v3/projects/36521caf8d4c4c6cb26a65f6519db223 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:22.242020 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.242916 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.243278 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.266829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:22.268502 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:22.352342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1423/2810] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:22.361312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.361606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.362089 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.405534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:22.407308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:22.429488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1388/2811] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:22.433593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:22.440433 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:22.450944 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733fb2d-d374-4c54-b5d8-566971487624 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.461257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.462479 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.463132 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.463690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.464922 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:33:22.465427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.468044 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.484569 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1424/2812] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:33:22.490985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:22.505309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a656f-4c98-425a-89bb-b7480eff4976 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.510303 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.510934 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.511209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.511480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.512131 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.514088 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.553135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1389/2813] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:22.555975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:22.567686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bb231-d966-47df-9750-c7ef49774f97 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.630406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.631104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.631380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.631656 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.632340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.634685 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.660401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1425/2814] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:22.664973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:22.676710 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cdf6-927a-41c1-bca8-9c8685ba071f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.681564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.682180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.682458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.682729 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.683375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.685022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.697705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1390/2815] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:22.702201 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:22.719216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a914-3c55-4378-b337-94732be684ff admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.724832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaaed4-64dd-4090-934e-f2d65a9caad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.725649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaaed4-64dd-4090-934e-f2d65a9caad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.725923 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaaed4-64dd-4090-934e-f2d65a9caad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.726320 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaaed4-64dd-4090-934e-f2d65a9caad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.727050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaaed4-64dd-4090-934e-f2d65a9caad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.728792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaaed4-64dd-4090-934e-f2d65a9caad7 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.740715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1426/2816] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:22.745764 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:22.760692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27ebd-5e6f-435c-8acb-83d4f0868ff2 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:22.770301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:22.770993 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.771463 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.771755 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] PATH_INFO: `/v3/projects/bc45fd7edd3146c1a31f96186d628f0e/users/07b6023666074a4ab817163d6d744052/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.791396 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc45fd7edd3146c1a31f96186d628f0e, user_id=07b6023666074a4ab817163d6d744052, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:22.796105 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:22.815483 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1391/2817] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:22 2022] PUT /identity/v3/projects/bc45fd7edd3146c1a31f96186d628f0e/users/07b6023666074a4ab817163d6d744052/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:22.827442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.827812 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.828160 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.861708 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] MFA Rules not processed for user `07b6023666074a4ab817163d6d744052`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:22.863099 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:22.939715 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1427/2818] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:22.944667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.016327 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e280828-1ad6-492a-afea-79ec0b4e0516 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.021815 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.022456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.022732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.023003 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.023670 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.025677 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.075705 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1392/2819] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:23.079416 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.095181 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992756aa-863c-437a-9e69-26215c1d65d7 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.161496 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:23.169688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.170366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.170824 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.171131 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.171780 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.173832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.199840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1428/2820] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:23 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:23.205415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.217672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763b2ba-5803-4a35-af78-4c82411c7ce0 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.223820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.223820 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.224300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.224300 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.226021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.229469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.244046 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1393/2821] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:23.252088 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.263173 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4c924-9d01-414e-b204-6cd64f8d7f40 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.268457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.269300 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.269680 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.270042 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] PATH_INFO: `/v3/projects/a77f2b681586460dae3ea3b2e1b79eee/users/275212010547479c804fccb712ba7daf/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.287411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77f2b681586460dae3ea3b2e1b79eee, user_id=275212010547479c804fccb712ba7daf, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.290193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.311777 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1429/2822] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:23 2022] PUT /identity/v3/projects/a77f2b681586460dae3ea3b2e1b79eee/users/275212010547479c804fccb712ba7daf/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:23.317173 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.328545 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12776-2372-4e87-8202-9f0af569dbb4 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.374691 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:23.402339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644dd2d-11f6-4508-ad6c-2eab6249bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.402967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644dd2d-11f6-4508-ad6c-2eab6249bdea admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.403288 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644dd2d-11f6-4508-ad6c-2eab6249bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.403503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644dd2d-11f6-4508-ad6c-2eab6249bdea admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.404158 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644dd2d-11f6-4508-ad6c-2eab6249bdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.405798 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644dd2d-11f6-4508-ad6c-2eab6249bdea admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.420541 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1394/2823] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:23.421797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.434351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ccbb9-bf19-444e-bd60-3f543df6f57d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.440010 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.440750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.441001 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.441289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] PATH_INFO: `/v3/projects/a77f2b681586460dae3ea3b2e1b79eee/users/275212010547479c804fccb712ba7daf/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.443256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77f2b681586460dae3ea3b2e1b79eee, user_id=275212010547479c804fccb712ba7daf, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.445903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.457610 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1430/2824] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:23 2022] PUT /identity/v3/projects/a77f2b681586460dae3ea3b2e1b79eee/users/275212010547479c804fccb712ba7daf/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:23.470165 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.470492 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.470763 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.505076 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] MFA Rules not processed for user `275212010547479c804fccb712ba7daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:23.506320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:23.590613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1395/2825] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:23.603220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.605287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:23.678032 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455113a-534e-4cd2-88e5-166977587dad admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.682345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04974-6585-4ba7-9608-f374c629020d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.682981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04974-6585-4ba7-9608-f374c629020d service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.683257 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04974-6585-4ba7-9608-f374c629020d service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.683529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04974-6585-4ba7-9608-f374c629020d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.695676 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04974-6585-4ba7-9608-f374c629020d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.697268 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04974-6585-4ba7-9608-f374c629020d service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.710774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1431/2826] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:24.273732 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:24.349872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4fca4-2b71-4ecb-a3dc-3ab2d984aad8 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:24.355434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:24.356067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:24.356375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:24.356643 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] PATH_INFO: `/v3/users/07b6023666074a4ab817163d6d744052` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:24.357930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b6023666074a4ab817163d6d744052)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:24.360030 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:24.417635 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b6023666074a4ab817163d6d744052'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:24.428552 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b6023666074a4ab817163d6d744052'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:24.429473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b6023666074a4ab817163d6d744052'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:24.437893 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:24.445401 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b6023666074a4ab817163d6d744052'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:24.457228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b6023666074a4ab817163d6d744052'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:24.463702 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1396/2827] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:24 2022] DELETE /identity/v3/users/07b6023666074a4ab817163d6d744052 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:24.468684 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:24.469283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:24.469283 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:24.508115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:24.510463 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:24.586459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1432/2828] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:24.597891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:24.599430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:24.671664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb01a6-6fd7-4e1e-952a-8f0bb909104f admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:24.675889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:24.676568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:24.676914 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:24.677186 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:24.687606 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:24.689170 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:24.699097 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1397/2829] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:25.015438 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:25.017168 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:25.030959 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021d89e-a7b1-49db-b569-60d1ef30bcab None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:25.041423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:25.044520 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:25.044852 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:25.045140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] PATH_INFO: `/v3/projects/bc45fd7edd3146c1a31f96186d628f0e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:25.048101 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc45fd7edd3146c1a31f96186d628f0e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:25.049583 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:25.110423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:25.112060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc45fd7edd3146c1a31f96186d628f0e', 'request_id': 'req-e5c0c28d-c11c-4171-8bdb-339b723d2b16'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.123221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc45fd7edd3146c1a31f96186d628f0e', 'request_id': 'req-e5c0c28d-c11c-4171-8bdb-339b723d2b16'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.135532 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc45fd7edd3146c1a31f96186d628f0e', 'request_id': 'req-e5c0c28d-c11c-4171-8bdb-339b723d2b16'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.149518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] The token cache is being invalidate because project bc45fd7edd3146c1a31f96186d628f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:25.149770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.150603 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.153073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1433/2830] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:25 2022] DELETE /identity/v3/projects/bc45fd7edd3146c1a31f96186d628f0e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:25.157348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:25.167871 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e648-11db-470e-b7e2-aab9eb807de6 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:25.239520 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:25.240168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:25.240438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:25.241784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] PATH_INFO: `/v3/users/275212010547479c804fccb712ba7daf` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:25.243462 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275212010547479c804fccb712ba7daf)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:25.245512 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:25.309807 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275212010547479c804fccb712ba7daf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.319730 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275212010547479c804fccb712ba7daf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.320384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275212010547479c804fccb712ba7daf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.336298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275212010547479c804fccb712ba7daf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.355113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-d67d7c64-6a93-4d23-98bc-62578ba48012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275212010547479c804fccb712ba7daf'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.371125 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1398/2831] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:25 2022] DELETE /identity/v3/users/275212010547479c804fccb712ba7daf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:25.681017 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:25.683371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:25.700882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c28d-c11c-4171-8bdb-339b723d2b16 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:25.775331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:25.775912 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:25.776192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:25.776467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] PATH_INFO: `/v3/projects/a77f2b681586460dae3ea3b2e1b79eee` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:25.777786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77f2b681586460dae3ea3b2e1b79eee)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:25.779797 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:25.854660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77f2b681586460dae3ea3b2e1b79eee', 'request_id': 'req-e02a1bda-e2e8-400b-ba13-1d1094d02776'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.862515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77f2b681586460dae3ea3b2e1b79eee', 'request_id': 'req-e02a1bda-e2e8-400b-ba13-1d1094d02776'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.872651 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77f2b681586460dae3ea3b2e1b79eee', 'request_id': 'req-e02a1bda-e2e8-400b-ba13-1d1094d02776'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.891134 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] The token cache is being invalidate because project a77f2b681586460dae3ea3b2e1b79eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:25.891635 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.894025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-e02a1bda-e2e8-400b-ba13-1d1094d02776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:25.895665 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1434/2832] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:25 2022] DELETE /identity/v3/projects/a77f2b681586460dae3ea3b2e1b79eee => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:25.900955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:25.901244 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:25.901536 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:25.910384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:25.928092 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:25.930112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:25.998998 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1399/2833] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:26.007571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.007829 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.008097 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.032536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:26.033752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:26.043736 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1435/2834] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:26.049256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.061232 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d64a-a4f7-420c-a88c-37fef0d77c09 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.067902 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.068529 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.068910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.069265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.069959 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:33:26.070267 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.071877 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.085154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1400/2835] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:33:26.090643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.102322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dcfcf-c37c-4b28-98d4-60d1f6542f47 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.108615 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.109274 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.109545 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.109843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.111147 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.113085 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.145536 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1436/2836] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:26.150138 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.161414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dafa6-c3f3-46f1-9356-6ab6981c6457 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.237066 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.237716 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.237992 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.238262 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.239169 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.240918 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.269141 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1401/2837] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:26.274785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.290721 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345682a-58ab-421c-9e45-42726e9c0d15 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.300359 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.301429 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.301842 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.302482 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.303386 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.309087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.336776 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1437/2838] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:26.342660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.355426 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3a60c-b60e-4e55-ac0f-194d976d8a3c admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.360937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bfe75-0dc4-4153-88f4-391eeac07ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.361252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bfe75-0dc4-4153-88f4-391eeac07ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.361518 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bfe75-0dc4-4153-88f4-391eeac07ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.361787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bfe75-0dc4-4153-88f4-391eeac07ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.362465 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bfe75-0dc4-4153-88f4-391eeac07ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.366061 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bfe75-0dc4-4153-88f4-391eeac07ae6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.379196 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1402/2839] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:26.384540 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.397302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acd302-c0f3-4442-a289-7947be1b03a5 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.402643 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.403401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.403673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.403951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] PATH_INFO: `/v3/projects/a139997d7e964927bccdc3f4c3c711d1/users/5f2583f439c4437a9530780df0a7cd2d/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.426208 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a139997d7e964927bccdc3f4c3c711d1, user_id=5f2583f439c4437a9530780df0a7cd2d, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.428926 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.447666 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1438/2840] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:26 2022] PUT /identity/v3/projects/a139997d7e964927bccdc3f4c3c711d1/users/5f2583f439c4437a9530780df0a7cd2d/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:26.460589 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.461031 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.461292 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.496440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] MFA Rules not processed for user `5f2583f439c4437a9530780df0a7cd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:26.497749 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:26.576387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:26.583863 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1403/2841] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:26.589997 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.599039 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:26.696981 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f4c8-4d71-4944-93a9-263f90b3d70a admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.704093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.705200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.705678 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.706060 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.706790 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.710249 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.754911 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1439/2842] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:26.759368 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.771457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf3c8b-a297-4548-b623-8b68ef600039 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.850065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.850772 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.851057 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.851337 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.852037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.854154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.882124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1404/2843] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:26.886593 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.898906 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd31a-2344-4669-ad3f-f61d161a5bf3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.905629 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.906448 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.906904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.907341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.908084 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.909961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.926653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1440/2844] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:26.931885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:26.944973 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190227-59ae-4288-9d84-040d0db5adc1 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:26.953742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:26.954714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.955134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.955446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] PATH_INFO: `/v3/projects/845421d9fd7a4df6b5aca1496eb1f204/users/a34d319ac9f8432ca201842c49f686e6/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.979195 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=845421d9fd7a4df6b5aca1496eb1f204, user_id=a34d319ac9f8432ca201842c49f686e6, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:26.982279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:26.998878 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1405/2845] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:26 2022] PUT /identity/v3/projects/845421d9fd7a4df6b5aca1496eb1f204/users/a34d319ac9f8432ca201842c49f686e6/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:27.003687 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:27.014754 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8062c-63ae-421a-8bef-9ac8519cefe2 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:27.084592 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fb821-418d-4b1b-a986-0f58351a0d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:27.085304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fb821-418d-4b1b-a986-0f58351a0d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:27.085559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fb821-418d-4b1b-a986-0f58351a0d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:27.085816 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fb821-418d-4b1b-a986-0f58351a0d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.086497 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fb821-418d-4b1b-a986-0f58351a0d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:27.088116 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fb821-418d-4b1b-a986-0f58351a0d74 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:27.099658 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1441/2846] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:27.104151 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:27.115336 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6b2b-469c-4246-9831-08c3d06556fb admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:27.120458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:27.121168 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:27.121459 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:27.121727 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] PATH_INFO: `/v3/projects/845421d9fd7a4df6b5aca1496eb1f204/users/a34d319ac9f8432ca201842c49f686e6/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.123658 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845421d9fd7a4df6b5aca1496eb1f204, user_id=a34d319ac9f8432ca201842c49f686e6, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:27.127079 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:27.138080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1406/2847] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:27 2022] PUT /identity/v3/projects/845421d9fd7a4df6b5aca1496eb1f204/users/a34d319ac9f8432ca201842c49f686e6/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:27.149384 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:27.149789 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:27.150156 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.180408 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] MFA Rules not processed for user `a34d319ac9f8432ca201842c49f686e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:27.181714 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:27.249216 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:27.255707 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1442/2848] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:27.268124 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:27.269984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:27.331500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699438f-1f62-455c-a4e5-4750b386f209 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:27.336180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:27.336876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:27.337156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:27.337427 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.349726 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:27.351234 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:27.363390 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1407/2849] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:27.422190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:27.424104 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:27.437049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c771eae-eb74-480e-bdfb-a1865c51015e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:27.441234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912c990-da2c-4a63-a708-23bd565ca751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:27.441883 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c990-da2c-4a63-a708-23bd565ca751 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:27.442162 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c990-da2c-4a63-a708-23bd565ca751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:27.442432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c990-da2c-4a63-a708-23bd565ca751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.504524 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912c990-da2c-4a63-a708-23bd565ca751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:27.506053 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912c990-da2c-4a63-a708-23bd565ca751 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:27.516079 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1443/2850] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:31.080921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:31.143873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.156676 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8fcc5-6eab-41d2-9511-b0540e24bab0 service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:31.165629 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:31.166694 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.167154 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.167631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] PATH_INFO: `/v3/users/5f2583f439c4437a9530780df0a7cd2d` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.169526 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2583f439c4437a9530780df0a7cd2d)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:31.173304 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:31.256134 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2583f439c4437a9530780df0a7cd2d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.266062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2583f439c4437a9530780df0a7cd2d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.266844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2583f439c4437a9530780df0a7cd2d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.285428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2583f439c4437a9530780df0a7cd2d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.296775 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2583f439c4437a9530780df0a7cd2d'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.304104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1408/2851] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:31 2022] DELETE /identity/v3/users/5f2583f439c4437a9530780df0a7cd2d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:31.309396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.310049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.310049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.331538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:31.332832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:31.410217 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1444/2852] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:31.420364 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:31.422233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:31.494672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9779f-338f-45a6-ba1f-e99ece14bdcd admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:31.499487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:31.500107 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.500415 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.500742 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.511276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:31.512687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:31.525041 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1409/2853] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:31.866815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:31.868972 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:31.882066 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798e53d-d13f-4f22-b8f6-28cbd2be4106 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:31.887255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:31.887546 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.887799 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.888061 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] PATH_INFO: `/v3/projects/a139997d7e964927bccdc3f4c3c711d1` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.889235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a139997d7e964927bccdc3f4c3c711d1)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:31.891302 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:31.953068 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a139997d7e964927bccdc3f4c3c711d1', 'request_id': 'req-a5d33996-0504-4438-9a24-720065db8aad'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.962370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a139997d7e964927bccdc3f4c3c711d1', 'request_id': 'req-a5d33996-0504-4438-9a24-720065db8aad'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.972449 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a139997d7e964927bccdc3f4c3c711d1', 'request_id': 'req-a5d33996-0504-4438-9a24-720065db8aad'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.991467 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] The token cache is being invalidate because project a139997d7e964927bccdc3f4c3c711d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:31.991802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.992461 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:31.994400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1445/2854] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:31 2022] DELETE /identity/v3/projects/a139997d7e964927bccdc3f4c3c711d1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:31.998625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:32.009331 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1b118-7850-448f-8d92-e0c7f1901283 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:32.075456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:32.076101 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:32.076376 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:32.076651 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] PATH_INFO: `/v3/users/a34d319ac9f8432ca201842c49f686e6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:32.077838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34d319ac9f8432ca201842c49f686e6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:32.080333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:32.101113 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:32.151021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34d319ac9f8432ca201842c49f686e6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.163192 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34d319ac9f8432ca201842c49f686e6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.163838 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34d319ac9f8432ca201842c49f686e6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.180508 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34d319ac9f8432ca201842c49f686e6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.194899 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-2e5acd23-0df6-479f-baab-5ea63e81e002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34d319ac9f8432ca201842c49f686e6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.206666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1410/2855] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:31 2022] DELETE /identity/v3/users/a34d319ac9f8432ca201842c49f686e6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:32.545623 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:32.549192 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:32.578100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33996-0504-4438-9a24-720065db8aad admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:32.604372 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:32.660225 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:32.660928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:32.661204 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:32.661470 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] PATH_INFO: `/v3/projects/845421d9fd7a4df6b5aca1496eb1f204` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:32.662744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=845421d9fd7a4df6b5aca1496eb1f204)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:32.664905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:32.725252 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845421d9fd7a4df6b5aca1496eb1f204', 'request_id': 'req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.732821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845421d9fd7a4df6b5aca1496eb1f204', 'request_id': 'req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.742220 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845421d9fd7a4df6b5aca1496eb1f204', 'request_id': 'req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.754649 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] The token cache is being invalidate because project 845421d9fd7a4df6b5aca1496eb1f204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:32.755119 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.755974 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-f5b7011d-367f-47d7-9363-d5b7dd9afc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:32.758287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1446/2856] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:32 2022] DELETE /identity/v3/projects/845421d9fd7a4df6b5aca1496eb1f204 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:32.763841 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:32.764142 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:32.764400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:32.785580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:32.787176 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:32.858007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1411/2857] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:32.866773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:32.867049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:32.867318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:32.890277 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:32.892328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:32.902120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1447/2858] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:32.907014 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:32.916804 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2bd2b-8b1b-49b8-9852-782fbbefe725 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:32.921654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:32.922620 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:32.922891 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:32.923157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:32.923844 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:33:32.924119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:32.925873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:32.939466 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1412/2859] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:33:32.944342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:32.954301 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c489-2d9b-4ee5-9389-9d396009e1e4 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:32.959293 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:32.959933 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:32.960205 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:32.960464 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:32.961139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:32.963050 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:32.993618 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1448/2860] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:32 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:32.998420 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.010791 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7cb2-1046-4c90-a5d9-231c98757361 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.076162 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.076856 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.077143 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.077417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.078059 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.080160 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.104407 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1413/2861] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:32 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:33:33.109366 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.121702 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862af6e-8d58-42ba-901c-9765510fdf26 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.127559 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.128197 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.128477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.128808 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.129469 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.131141 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.142832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1449/2862] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:33.147221 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.158309 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663737e9-70d5-4677-a558-b730c140d5ed admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.163414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3adf43-b417-4a17-9eb2-fc697615c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.164037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3adf43-b417-4a17-9eb2-fc697615c7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.164310 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3adf43-b417-4a17-9eb2-fc697615c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.164574 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3adf43-b417-4a17-9eb2-fc697615c7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.165261 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3adf43-b417-4a17-9eb2-fc697615c7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.166884 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3adf43-b417-4a17-9eb2-fc697615c7c6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.173274 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:33.183666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1414/2863] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:33.189807 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.201425 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1ca9-55e8-49eb-b98f-468a5a6b606d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.206785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.207462 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.207740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.208014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] PATH_INFO: `/v3/projects/57558600bc1e4105a1c07ad5840228a5/users/e950a577bb394b72bc71d70a300de058/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.225095 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57558600bc1e4105a1c07ad5840228a5, user_id=e950a577bb394b72bc71d70a300de058, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.227755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.246884 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1450/2864] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:33 2022] PUT /identity/v3/projects/57558600bc1e4105a1c07ad5840228a5/users/e950a577bb394b72bc71d70a300de058/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:33.259609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.259950 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.260256 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.290872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] MFA Rules not processed for user `e950a577bb394b72bc71d70a300de058`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:33.292109 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:33.367577 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1415/2865] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:33.372982 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.454724 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:33.480579 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e570bd8-3fbc-4b48-9c43-b644e6bcf380 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.487654 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.488331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.488544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.488841 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.489495 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.491437 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.528198 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1451/2866] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:33 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:33.533782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.546022 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7d712-d9c9-4c53-8fb6-c436596894c9 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.618630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.619136 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.619417 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.619692 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.620515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.624246 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.657796 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1416/2867] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:33 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:33.663882 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.677406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580c66c-e191-46fb-87a3-c2a203d55589 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.684529 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.685686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.686148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.686624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.688209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.691139 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.712645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1452/2868] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:33.718387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.736114 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fef4f9-1e9b-4c0d-85ca-191c8c1a0c17 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.744044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.744835 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.745209 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.745597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] PATH_INFO: `/v3/projects/619bfc24b089415ba804023d4013aed6/users/b2d4f833fc32426b859b3dc05d3498e3/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.767790 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619bfc24b089415ba804023d4013aed6, user_id=b2d4f833fc32426b859b3dc05d3498e3, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.770972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.794024 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1417/2869] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:33 2022] PUT /identity/v3/projects/619bfc24b089415ba804023d4013aed6/users/b2d4f833fc32426b859b3dc05d3498e3/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:33.805241 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.819690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024e14-e1ee-4a23-9ec2-0c435e1a1aac admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.889881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f372c-1909-4e1f-8fc4-0c3347d4caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.890420 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f372c-1909-4e1f-8fc4-0c3347d4caf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.890690 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f372c-1909-4e1f-8fc4-0c3347d4caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.891368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f372c-1909-4e1f-8fc4-0c3347d4caf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.892187 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f372c-1909-4e1f-8fc4-0c3347d4caf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.894022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f372c-1909-4e1f-8fc4-0c3347d4caf9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.911163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1453/2870] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:33.915874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:33.930202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea1ec1-526f-4dec-9bb4-bf6c7c44e094 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:33.935610 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:33.936308 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.936587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.936894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] PATH_INFO: `/v3/projects/619bfc24b089415ba804023d4013aed6/users/b2d4f833fc32426b859b3dc05d3498e3/roles/73d94b00a1864422b65efc55999d79b0` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:33.939035 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619bfc24b089415ba804023d4013aed6, user_id=b2d4f833fc32426b859b3dc05d3498e3, role_id=73d94b00a1864422b65efc55999d79b0)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:33.941799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:33.954051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1418/2871] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:33 2022] PUT /identity/v3/projects/619bfc24b089415ba804023d4013aed6/users/b2d4f833fc32426b859b3dc05d3498e3/roles/73d94b00a1864422b65efc55999d79b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:33.967996 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:33.968305 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:33.968577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:34.002522 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] MFA Rules not processed for user `b2d4f833fc32426b859b3dc05d3498e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:34.003868 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:34.098538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1454/2872] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:34.118106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:34.120669 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:34.171873 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:34.187667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d246c8-f8a4-417f-8d86-d16be1633ef3 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:34.191887 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eb6ce-f7bd-4884-bac4-2a46ff88fb2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:34.192524 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb6ce-f7bd-4884-bac4-2a46ff88fb2f service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:34.192832 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb6ce-f7bd-4884-bac4-2a46ff88fb2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:34.193112 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb6ce-f7bd-4884-bac4-2a46ff88fb2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:34.203657 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eb6ce-f7bd-4884-bac4-2a46ff88fb2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:34.205313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eb6ce-f7bd-4884-bac4-2a46ff88fb2f service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:34.216700 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1419/2873] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:34.257012 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:34.345929 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:34.372255 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9261d8-11c9-451d-a67a-0794a8161311 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:34.378130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:34.378773 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:34.379069 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:34.379334 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] PATH_INFO: `/v3/users/e950a577bb394b72bc71d70a300de058` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:34.380913 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e950a577bb394b72bc71d70a300de058)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:34.382778 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:34.443321 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e950a577bb394b72bc71d70a300de058'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:34.443985 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e950a577bb394b72bc71d70a300de058'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:34.454586 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e950a577bb394b72bc71d70a300de058'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:34.468858 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e950a577bb394b72bc71d70a300de058'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:34.476183 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e950a577bb394b72bc71d70a300de058'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:34.483289 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1455/2874] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:34 2022] DELETE /identity/v3/users/e950a577bb394b72bc71d70a300de058 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:34.489723 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:34.490098 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:34.490515 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:34.513164 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:34.514418 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:34.597697 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1420/2875] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:34.608459 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:34.610200 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:34.680900 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd2945-f088-487e-a63a-ca40405e3d1f admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:34.687070 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:34.687740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:34.688388 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:34.689645 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:34.702747 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:34.706266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:34.723149 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1456/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:35.073579 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:35.075156 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:35.087813 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b55b-0308-43eb-9433-5375e91be270 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:35.093139 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:35.093799 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:35.094108 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:35.094498 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] PATH_INFO: `/v3/projects/57558600bc1e4105a1c07ad5840228a5` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:35.095972 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57558600bc1e4105a1c07ad5840228a5)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:35.098128 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:35.157068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57558600bc1e4105a1c07ad5840228a5', 'request_id': 'req-ed4708c0-313a-4604-ab9f-3f72c8b94028'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.164149 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57558600bc1e4105a1c07ad5840228a5', 'request_id': 'req-ed4708c0-313a-4604-ab9f-3f72c8b94028'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.172042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57558600bc1e4105a1c07ad5840228a5', 'request_id': 'req-ed4708c0-313a-4604-ab9f-3f72c8b94028'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.190229 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] The token cache is being invalidate because project 57558600bc1e4105a1c07ad5840228a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:35.190528 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.191342 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.193348 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1421/2877] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:35 2022] DELETE /identity/v3/projects/57558600bc1e4105a1c07ad5840228a5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:35.199325 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:35.217016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d866-8712-4981-b714-5a9aefb761c9 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:35.303554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:35.304105 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:35.304376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:35.304667 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] PATH_INFO: `/v3/users/b2d4f833fc32426b859b3dc05d3498e3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:35.305819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d4f833fc32426b859b3dc05d3498e3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:35.307770 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:35.313350 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:35.369266 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d4f833fc32426b859b3dc05d3498e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.370349 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d4f833fc32426b859b3dc05d3498e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.381792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d4f833fc32426b859b3dc05d3498e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.397762 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d4f833fc32426b859b3dc05d3498e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.407100 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-a74e3809-0c6f-4f6c-ba3d-c86e75b40086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d4f833fc32426b859b3dc05d3498e3'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.414751 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1457/2878] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:35 2022] DELETE /identity/v3/users/b2d4f833fc32426b859b3dc05d3498e3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:35.783444 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:35.786013 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:35.806693 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4708c0-313a-4604-ab9f-3f72c8b94028 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:35.888405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:35.889095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:35.889374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:35.889646 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] PATH_INFO: `/v3/projects/619bfc24b089415ba804023d4013aed6` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:35.890875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619bfc24b089415ba804023d4013aed6)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:35.893739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:35.906599 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:35.966901 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619bfc24b089415ba804023d4013aed6', 'request_id': 'req-3a4a126e-a525-4e98-823f-e57e076d2631'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.974399 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619bfc24b089415ba804023d4013aed6', 'request_id': 'req-3a4a126e-a525-4e98-823f-e57e076d2631'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:35.981713 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619bfc24b089415ba804023d4013aed6', 'request_id': 'req-3a4a126e-a525-4e98-823f-e57e076d2631'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:36.000222 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] The token cache is being invalidate because project 619bfc24b089415ba804023d4013aed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:36.001265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:36.002490 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-3a4a126e-a525-4e98-823f-e57e076d2631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:36.005488 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1422/2879] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:35 2022] DELETE /identity/v3/projects/619bfc24b089415ba804023d4013aed6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:33:36.012087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.019270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.019270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.039175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:36.041118 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:36.121584 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1458/2880] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:36.132021 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.132416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.133180 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.159458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:36.161457 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:36.170233 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1423/2881] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:36.175893 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.187380 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203fd0b-f268-43d9-8000-d9382e61d013 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.193124 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.193753 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.194027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.194296 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] PATH_INFO: `/v3/domains` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.194955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:33:36.195270 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.196928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.211631 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1459/2882] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:33:36.216906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.233333 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8475c-0629-4676-bebf-1b8c83e23a08 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.242414 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.243784 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.244276 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.244794 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.245946 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.251137 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.284580 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1424/2883] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:33:36 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:36.289218 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.302341 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c370343-7ade-4d12-b58b-55243ae40593 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.386521 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.387625 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.388106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.388585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] PATH_INFO: `/v3/users` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.389814 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.393766 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.427000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:36.439452 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1460/2884] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:33:36 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:33:36.443837 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.456989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf0f54-a4db-49fa-ab8a-ad56edda8429 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.464507 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.465349 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.465752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.466263 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.467071 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.469521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.482260 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1425/2885] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:33:36.487399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.499679 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646697f-645a-40fc-8a85-a5789e766a98 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.504752 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819dcc8-20ba-4bd4-8d77-03633b045049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.505401 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819dcc8-20ba-4bd4-8d77-03633b045049 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.505677 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819dcc8-20ba-4bd4-8d77-03633b045049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.505943 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819dcc8-20ba-4bd4-8d77-03633b045049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.506624 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819dcc8-20ba-4bd4-8d77-03633b045049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.508339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819dcc8-20ba-4bd4-8d77-03633b045049 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.522411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1461/2886] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:33:36.527184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.538594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de06d6-0378-427a-8aa8-3e4cdc326dac admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.543660 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.544339 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.544609 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.544915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] PATH_INFO: `/v3/projects/b3af081f40064ccd955287583412232e/users/ee8152d302a64bee9c53faff93d2ce52/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.564175 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3af081f40064ccd955287583412232e, user_id=ee8152d302a64bee9c53faff93d2ce52, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.567040 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.585080 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1426/2887] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:33:36 2022] PUT /identity/v3/projects/b3af081f40064ccd955287583412232e/users/ee8152d302a64bee9c53faff93d2ce52/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:36.591755 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9f74-0889-4fc2-9152-3b3bf843d655 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.592106 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9f74-0889-4fc2-9152-3b3bf843d655 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.592389 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9f74-0889-4fc2-9152-3b3bf843d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.614954 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-ddfe9f74-0889-4fc2-9152-3b3bf843d655 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:36.616370 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-ddfe9f74-0889-4fc2-9152-3b3bf843d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:36.683965 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1462/2888] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:36.757612 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:36.759626 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:36.827885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2abe-e26d-461d-b506-962fa44290f5 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.832354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.833017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.833295 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.833564 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.844987 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.846454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.857597 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1427/2889] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:38.015703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b30fe-5334-43da-a306-27fbaaf453e7 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:38.016938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b30fe-5334-43da-a306-27fbaaf453e7 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:38.017427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b30fe-5334-43da-a306-27fbaaf453e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:38.077638 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-716b30fe-5334-43da-a306-27fbaaf453e7 None None] MFA Rules not processed for user `ee8152d302a64bee9c53faff93d2ce52`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:38.080175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-716b30fe-5334-43da-a306-27fbaaf453e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:38.196519 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1463/2890] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:38.213365 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:38.216029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:38.297313 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:38.326480 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2521b-5f4e-4f85-bc2c-4ba6ad599e44 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:38.332739 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:38.333411 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:38.333956 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:38.334454 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:38.351103 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:38.354017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:38.368999 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1428/2891] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:40.906611 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:40.907353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:40.907353 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:40.927601 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] MFA Rules not processed for user `ee8152d302a64bee9c53faff93d2ce52`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:40.928850 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:40.935865 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1464/2892] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:41.235701 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:41.247706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54ec21-23bc-4ddf-88e6-e1b05a2dc15d service cinder] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:41.252737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:41.253436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:41.253847 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:41.254231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:41.257250 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:41.268576 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:41.270110 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:41.280067 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1429/2893] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:41.673317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:41.677979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:41.773979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88201-66bd-4392-95c1-a65177586e0d None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:41.780087 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:41.780564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:41.780967 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:41.781314 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:41.783355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:41.798742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:41.800368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:41.811823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1465/2894] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:43.836409 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:43.847350 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a816-2387-4b61-82ac-c4162a7372c9 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:43.850979 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:43.851585 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:43.851889 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:43.852159 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:43.853916 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:43.859761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:43.862544 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:43.864555 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:43.866025 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:43.868444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=100 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:43.874581 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382af1e-d2e4-420c-8356-102bad79bd51 service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:43.877622 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1430/2895] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:43.878888 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:43.879509 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:43.879843 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:43.880115 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:43.882018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:43.893090 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:43.894897 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:43.904743 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1466/2896] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:44.642608 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:44.644543 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:44.746903 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c83c-4169-4884-bacb-359150ce3b85 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:44.755068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:44.756078 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:44.756711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:44.756915 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:44.759191 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:44.777446 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:44.779510 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fc0c3-b5e4-40d5-996a-0df56f5d4648 service nova] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:44.792872 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1431/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:46.238478 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:46.240049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.263564 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d304c17-5500-4c2a-8a31-23d1030c824b service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:46.271703 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:46.272820 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:46.273326 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:46.273817 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] PATH_INFO: `/v3/users/79b54c0102e146c495349606fa931dac` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:46.275796 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b54c0102e146c495349606fa931dac)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:46.279354 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:46.342130 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b54c0102e146c495349606fa931dac'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:46.342785 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b54c0102e146c495349606fa931dac'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:46.353971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b54c0102e146c495349606fa931dac'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:46.369030 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b54c0102e146c495349606fa931dac'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:46.376431 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b54c0102e146c495349606fa931dac'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:46.383059 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1467/2898] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:33:46 2022] DELETE /identity/v3/users/79b54c0102e146c495349606fa931dac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:46.387965 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:46.388499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:46.388499 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:46.409982 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:46.413493 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.506161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1432/2899] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:46.518328 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:46.520175 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.595604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4984f-04a5-44a8-9cb8-e25cfbe61a16 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:46.599740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:46.600376 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:46.600673 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:46.600955 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:46.611406 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:46.612925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:46.623806 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1468/2900] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:46.978751 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:46.980284 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.996435 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82fd4-7425-41db-b526-3bc1b1b40f79 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:47.002301 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:47.003020 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:47.004037 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:47.004471 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] PATH_INFO: `/v3/projects/7f3179ec302246e7a31ed96371f03c6f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:47.006293 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3179ec302246e7a31ed96371f03c6f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:47.009319 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:47.054859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:47.067042 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3179ec302246e7a31ed96371f03c6f', 'request_id': 'req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:47.073161 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3179ec302246e7a31ed96371f03c6f', 'request_id': 'req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:47.080335 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3179ec302246e7a31ed96371f03c6f', 'request_id': 'req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:47.095051 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] The token cache is being invalidate because project 7f3179ec302246e7a31ed96371f03c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:33:47.095315 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:47.096028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:33:47.097628 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1433/2901] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:33:46 2022] DELETE /identity/v3/projects/7f3179ec302246e7a31ed96371f03c6f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:33:50.597120 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:50.598600 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:50.671644 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:50.680371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2998ca-46fb-412a-b32d-6283ccf5df07 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:50.747518 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a467a7344fff4987967c8655dc2965a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:50.748038 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:50.748307 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:50.748572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:50.750457 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:50.762979 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:50.764587 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efa08a-330f-49b2-9bb3-37ab631d347b service nova] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:50.776455 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1469/2902] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:57.091614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:00.327179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:00.328370 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:00.391787 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664de5f-7ea7-45d5-b54e-d1ee0e0039c6 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:00.397062 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:00.398148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:00.398613 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:00.398942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:00.400955 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:00.475275 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:00.476746 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154491a9-0992-40e5-a968-5dbbdbf815b8 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:00.487602 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1434/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:00.550365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:00.550365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:00.550365 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:00.574096 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] MFA Rules not processed for user `ee8152d302a64bee9c53faff93d2ce52`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:00.575526 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:00.660373 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1470/2904] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:10.482245 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=50 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:10.652493 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=58 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:19.474656 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e97339-dabc-4131-a044-0ba03b8b7cfc None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:19.475248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e97339-dabc-4131-a044-0ba03b8b7cfc None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:19.475374 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e97339-dabc-4131-a044-0ba03b8b7cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:19.551854 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-80e97339-dabc-4131-a044-0ba03b8b7cfc None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:19.553440 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-80e97339-dabc-4131-a044-0ba03b8b7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:19.634911 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1435/2905] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Sep 1 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:19.688345 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:19.689870 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:19.801347 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1ef6-2c3a-4d24-8c78-648b83b2da2e None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:19.807964 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:19.808657 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:19.808935 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:19.809206 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:19.819071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:19.820691 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:19.829938 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1471/2906] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:34:29.631630 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=40 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:29.825961 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=41 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:35.199534 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:35.200122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:35.200122 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:35.222936 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] MFA Rules not processed for user `284d5528b1b84bd19e773ff09ee196ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:35.224210 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:35.231895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1436/2907] 10.222.0.57 () {58 vars in 967 bytes} [Thu Sep 1 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:35.245821 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:35.257580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fb3e2-15df-4a6a-9a91-49fae4600d4d service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:35.263960 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '594ce9d8a0164a559fa14327d308c7b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:35.264562 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:35.264901 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:35.265178 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:35.275127 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:35.276786 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:35.286557 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1472/2908] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Sep 1 05:34:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:34:37.362624 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:37.364206 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:37.442326 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0087d-f62e-4ca1-bb65-e62b431df755 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:37.447581 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:37.448228 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:37.448505 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:37.448789 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] PATH_INFO: `/v3/users/ee8152d302a64bee9c53faff93d2ce52` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:37.449941 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8152d302a64bee9c53faff93d2ce52)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:37.451906 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:37.507434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8152d302a64bee9c53faff93d2ce52'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.515050 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8152d302a64bee9c53faff93d2ce52'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.515781 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8152d302a64bee9c53faff93d2ce52'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.529910 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8152d302a64bee9c53faff93d2ce52'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.537583 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-c42bf953-7cf4-438b-8faf-115eff0ecdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8152d302a64bee9c53faff93d2ce52'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.543793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1437/2909] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:34:37 2022] DELETE /identity/v3/users/ee8152d302a64bee9c53faff93d2ce52 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:34:37.754128 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:37.766234 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c22ab-ee07-44e0-9b10-90d2e00b3704 service swift] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:37.845330 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:37.845969 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:37.846251 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:37.846573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] PATH_INFO: `/v3/projects/b3af081f40064ccd955287583412232e` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:37.847826 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3af081f40064ccd955287583412232e)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:37.849815 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:37.901655 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3af081f40064ccd955287583412232e', 'request_id': 'req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.909040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3af081f40064ccd955287583412232e', 'request_id': 'req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.918281 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3af081f40064ccd955287583412232e', 'request_id': 'req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.933818 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] The token cache is being invalidate because project b3af081f40064ccd955287583412232e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:34:37.934103 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.934804 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-72fe303b-bb99-4e6e-b483-1c2b3d4e94e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:37.936306 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1473/2910] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:34:37 2022] DELETE /identity/v3/projects/b3af081f40064ccd955287583412232e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:34:37.941461 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:37.941767 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:37.942034 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:37.963265 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:37.964487 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:38.027734 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1438/2911] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:38.035905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.036151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.036427 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.057857 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:38.059093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:38.069355 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1474/2912] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:38.073876 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.084469 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0548-a419-47b9-8c53-330d2f7b601a None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.090044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.090664 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.090952 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.091187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.091869 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:34:38.092224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.094741 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.103896 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:38.107947 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1439/2913] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:34:38.112840 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.123742 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c564d4b-9e49-428b-893e-5adbd9b9da5c None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.130062 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.130764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.131140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.131585 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.132432 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.134577 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.165549 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1475/2914] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:34:38 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:34:38.170018 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.181044 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9227604-a364-49cd-ad27-6353eac5586d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.245586 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.246224 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.246503 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.246771 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.247433 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.249614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.274895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1440/2915] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:34:38 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:34:38.279823 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.291424 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33690ce-994e-47d4-9242-b7816ee0d393 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.296910 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.298209 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.298589 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.298962 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.299761 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.301571 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.312918 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1476/2916] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:34:38.317938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.328805 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0d79-0a7a-4df0-b46f-ae690b91c6e9 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.335456 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bf9c8-28f3-4cfa-ad4a-91da337ae1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.336068 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf9c8-28f3-4cfa-ad4a-91da337ae1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.336344 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf9c8-28f3-4cfa-ad4a-91da337ae1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.336615 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf9c8-28f3-4cfa-ad4a-91da337ae1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.337298 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bf9c8-28f3-4cfa-ad4a-91da337ae1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.338937 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bf9c8-28f3-4cfa-ad4a-91da337ae1a0 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.352473 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1441/2917] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:34:38.357642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.369322 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4ee94-6724-44b2-8238-ac1a56e22bf3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.374764 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.375534 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.375851 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.376108 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] PATH_INFO: `/v3/projects/d395eb7b91b14f5faa488240502180dc/users/833e576b4f2b4767b33faaadfd1e0039/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.393400 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d395eb7b91b14f5faa488240502180dc, user_id=833e576b4f2b4767b33faaadfd1e0039, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.396472 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.413660 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1477/2918] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:34:38 2022] PUT /identity/v3/projects/d395eb7b91b14f5faa488240502180dc/users/833e576b4f2b4767b33faaadfd1e0039/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:34:38.425667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.426517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.426517 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.459989 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] MFA Rules not processed for user `833e576b4f2b4767b33faaadfd1e0039`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:38.461563 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:38.542848 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1442/2919] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:38.556572 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:38.559368 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:38.585025 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:38.639014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b713a-f490-49f6-89c1-7c4b139e40f3 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:38.643719 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05beb-d83e-4f9c-8b1b-fe6cb8a20e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:38.644340 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05beb-d83e-4f9c-8b1b-fe6cb8a20e1e service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.644608 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05beb-d83e-4f9c-8b1b-fe6cb8a20e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.644905 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05beb-d83e-4f9c-8b1b-fe6cb8a20e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.654846 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05beb-d83e-4f9c-8b1b-fe6cb8a20e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:38.656291 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05beb-d83e-4f9c-8b1b-fe6cb8a20e1e service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:38.666316 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1478/2920] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:41.325202 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:41.391967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b7a1-43a8-4cf1-b41e-d1e75cfc598e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:41.396770 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:41.397428 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:41.397706 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:41.397967 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] PATH_INFO: `/v3/users/833e576b4f2b4767b33faaadfd1e0039` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:41.399155 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] RBAC: Authorizing `identity:delete_user(user_id=833e576b4f2b4767b33faaadfd1e0039)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:41.401328 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:41.413029 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:41.464458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833e576b4f2b4767b33faaadfd1e0039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:41.474362 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833e576b4f2b4767b33faaadfd1e0039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:41.475217 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833e576b4f2b4767b33faaadfd1e0039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:41.489631 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833e576b4f2b4767b33faaadfd1e0039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:41.497408 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833e576b4f2b4767b33faaadfd1e0039'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:41.504193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1443/2921] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:34:41 2022] DELETE /identity/v3/users/833e576b4f2b4767b33faaadfd1e0039 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:34:41.509443 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:41.509971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:41.509971 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:41.530358 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:41.531588 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:41.595445 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1479/2922] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:41.606148 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:41.607652 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:41.676594 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07a8c-1de1-4933-97af-290e3a1b456a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:41.680445 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde68fb-11c5-420c-b8bb-0fd815c0a523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:41.681123 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde68fb-11c5-420c-b8bb-0fd815c0a523 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:41.681400 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde68fb-11c5-420c-b8bb-0fd815c0a523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:41.681673 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde68fb-11c5-420c-b8bb-0fd815c0a523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:41.695179 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde68fb-11c5-420c-b8bb-0fd815c0a523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:41.696654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde68fb-11c5-420c-b8bb-0fd815c0a523 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:41.707561 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1444/2923] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:42.007813 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.009948 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:42.026223 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573f45-7463-4e13-91fb-0b5fade83d46 None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.031170 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.031958 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.035774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.035774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] PATH_INFO: `/v3/projects/d395eb7b91b14f5faa488240502180dc` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.035774 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d395eb7b91b14f5faa488240502180dc)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.041620 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.099853 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd395eb7b91b14f5faa488240502180dc', 'request_id': 'req-09efd3d7-61ee-4c70-a676-4812252143a1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:42.109339 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd395eb7b91b14f5faa488240502180dc', 'request_id': 'req-09efd3d7-61ee-4c70-a676-4812252143a1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:42.120411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd395eb7b91b14f5faa488240502180dc', 'request_id': 'req-09efd3d7-61ee-4c70-a676-4812252143a1'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:42.133371 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] The token cache is being invalidate because project d395eb7b91b14f5faa488240502180dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:34:42.133648 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:42.134357 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-09efd3d7-61ee-4c70-a676-4812252143a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:42.135903 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1480/2924] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:34:42 2022] DELETE /identity/v3/projects/d395eb7b91b14f5faa488240502180dc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:34:42.141312 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.141711 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.142189 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.163785 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:42.165045 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:42.227668 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1445/2925] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:34:42.236064 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.236342 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.236642 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.258018 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:42.259210 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:42.267566 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1481/2926] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:42.272135 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.282983 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986fcd-4221-43bf-bbf7-c1dc1290bdc3 None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.287686 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.288297 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.288568 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.288862 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] PATH_INFO: `/v3/domains` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.289625 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:34:42.289874 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.291434 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.303895 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1446/2927] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Sep 1 05:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:34:42.308442 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.318628 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed406a4-719d-489a-8e97-326b4bf6e8da None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.325112 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.325740 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.326014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.326282 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.326925 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.328975 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.363304 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1482/2928] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Sep 1 05:34:42 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:34:42.367637 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.379737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb01c-ff61-45c1-84b9-468688af096a admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.395588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:42.448360 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.449002 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.449281 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.449553 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.450187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.452104 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.478278 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1447/2929] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Sep 1 05:34:42 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:34:42.482576 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.494435 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7551c-ed82-41f6-92db-3c9d79c1f0bd admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.499428 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.500049 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.500317 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.501287 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] PATH_INFO: `/v3/roles` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.501946 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.503554 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.509286 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:42.515230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1483/2930] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:34:42.519867 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.530653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c925fb-5e12-4cb8-b4a3-b281e5911d7d admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.536900 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c59fd-e607-4e5d-81a3-35540c03fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.537375 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c59fd-e607-4e5d-81a3-35540c03fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.537653 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c59fd-e607-4e5d-81a3-35540c03fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.537921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c59fd-e607-4e5d-81a3-35540c03fa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.538588 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c59fd-e607-4e5d-81a3-35540c03fa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.540184 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c59fd-e607-4e5d-81a3-35540c03fa4c admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.552259 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1448/2931] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Sep 1 05:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:34:42.557247 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.569235 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6c1a0-c2ef-4f2b-ba4b-f33a8e7c946e admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.574411 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.575125 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.575399 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.575688 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] PATH_INFO: `/v3/projects/8698ad584d4246f996304038984b18d6/users/7fa623a6cb2b4939aa9e9acaa5f4ecbd/roles/05dc7b23426a4cc49791c2e6585774ad` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.597260 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8698ad584d4246f996304038984b18d6, user_id=7fa623a6cb2b4939aa9e9acaa5f4ecbd, role_id=05dc7b23426a4cc49791c2e6585774ad)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.599980 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.619602 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1484/2932] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Sep 1 05:34:42 2022] PUT /identity/v3/projects/8698ad584d4246f996304038984b18d6/users/7fa623a6cb2b4939aa9e9acaa5f4ecbd/roles/05dc7b23426a4cc49791c2e6585774ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:34:42.631377 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] REQUEST_METHOD: `POST` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.631663 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.631938 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.663617 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.auth.core [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] MFA Rules not processed for user `7fa623a6cb2b4939aa9e9acaa5f4ecbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:42.664885 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:42.733556 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1449/2933] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:42.745692 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:42.747639 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:42.810881 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f422c4-0d80-4029-a318-9e8d04b26c4d admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:42.816221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d39a8-68ef-4f69-a47f-d57ff842e6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9266a63ee919403f880344cfe2efb5a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:42.816880 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d39a8-68ef-4f69-a47f-d57ff842e6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.817155 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d39a8-68ef-4f69-a47f-d57ff842e6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.817423 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d39a8-68ef-4f69-a47f-d57ff842e6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.826744 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d39a8-68ef-4f69-a47f-d57ff842e6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:42.828185 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d39a8-68ef-4f69-a47f-d57ff842e6e0 service cinder] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:42.837499 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1485/2934] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:52.730225 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:52.833221 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:52.913157 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:52.981850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4fb6a-6d37-46af-ab22-90787196230e None None] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:52.987069 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:52.987707 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:52.987985 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:52.988257 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] PATH_INFO: `/v3/users/7fa623a6cb2b4939aa9e9acaa5f4ecbd` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:52.989438 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa623a6cb2b4939aa9e9acaa5f4ecbd)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:52.991403 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:53.041779 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa623a6cb2b4939aa9e9acaa5f4ecbd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.050593 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa623a6cb2b4939aa9e9acaa5f4ecbd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.051359 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa623a6cb2b4939aa9e9acaa5f4ecbd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.063719 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa623a6cb2b4939aa9e9acaa5f4ecbd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.071011 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa623a6cb2b4939aa9e9acaa5f4ecbd'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.077163 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1450/2935] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:34:52 2022] DELETE /identity/v3/users/7fa623a6cb2b4939aa9e9acaa5f4ecbd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:34:53.082254 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] REQUEST_METHOD: `POST` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:53.082539 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:53.082819 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:53.103107 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.auth.core [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] MFA Rules not processed for user `230f8b0dcb17425a90aa8f093d4d7ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:53.104338 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:53.167895 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1486/2936] 10.222.0.57 () {58 vars in 958 bytes} [Thu Sep 1 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:53.178596 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:53.180213 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:53.240028 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3827d-633f-46a2-b2f8-742285a9a294 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:53.244140 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:53.244797 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:53.245095 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:53.245387 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:53.256384 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:53.257866 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:53.267666 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1451/2937] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:53.565986 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:53.567466 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:53.580674 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657233-8ded-4547-9a52-b545d6a1138f None None] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:53.586269 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:53.586953 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:53.587226 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:53.587477 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] PATH_INFO: `/v3/projects/8698ad584d4246f996304038984b18d6` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:53.588661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8698ad584d4246f996304038984b18d6)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:53.590591 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:53.646538 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8698ad584d4246f996304038984b18d6', 'request_id': 'req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.653332 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8698ad584d4246f996304038984b18d6', 'request_id': 'req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.663908 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8698ad584d4246f996304038984b18d6', 'request_id': 'req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.676031 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] The token cache is being invalidate because project 8698ad584d4246f996304038984b18d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:34:53.676318 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.677071 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:34:53.678722 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1487/2938] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:34:53 2022] DELETE /identity/v3/projects/8698ad584d4246f996304038984b18d6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:35:03.263152 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:03.671705 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:30.557106 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:30.558737 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:30.632485 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5198fa-f1bc-4fad-b5b3-02c1ae4d8408 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:30.698850 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:30.699486 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:30.699766 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:30.700043 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:30.701968 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:30.714231 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:30.718017 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:30.729058 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1452/2939] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:40.724397 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=58 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:42.718126 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:42.719653 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:42.786507 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d736-c4d3-4c0b-bd7f-aab3c5b6fd70 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:42.792163 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:42.793151 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:42.793596 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:42.794022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:42.796076 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:42.808073 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:42.810028 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:42.820792 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1488/2940] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:42.910314 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:42.926187 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358814-0f6b-4e5b-b8c6-345a61786ce4 service placement] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:42.931930 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:42.932953 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:42.933525 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:42.933942 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:42.936793 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:43.038927 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:43.040346 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:43.052637 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1453/2941] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:52.816016 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=26 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:53.046875 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=34 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:24.892219 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:24.893951 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:24.905430 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf495-4ea5-478d-b5ef-32a567a226d5 service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:24.910573 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:24.911193 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:24.911613 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:24.911887 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:24.914140 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:24.985444 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:24.987113 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:24.998000 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1489/2942] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:38:26.232521 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:26.247654 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5540d-6fd3-40b5-8ffe-11fc0984daa2 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:26.254421 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:26.255048 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:26.255320 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:26.255587 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:26.258119 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:26.273984 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:26.275436 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:26.290687 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1454/2943] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:38:27.482904 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:27.492331 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7f4c-686b-47e0-ad1d-557ff901e37e service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:27.499191 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:27.500244 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:27.500949 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:27.501515 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:27.504211 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:27.529597 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:27.532027 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:27.546686 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1490/2944] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:38:30.147430 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:30.161166 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276312c9-6df7-44db-ab98-82331bacabd7 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:30.165063 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98a43f7e512946aab3f1d7ef7b8d4fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:30.165672 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:30.165981 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:30.166248 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:30.168065 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:30.233828 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:30.235279 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:30.245859 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1455/2945] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:38:33.843988 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:33.846844 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:33.913190 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf060-e287-4eba-83eb-3fc7eced62ae service neutron] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:33.919481 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:33.920014 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] REQUEST_METHOD: `GET` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:33.920276 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:33.920781 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:33.922750 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:33.937523 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:33.939267 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:33.953832 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1491/2946] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:38:37.951714 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:37.953369 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:38.000747 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548793c4-0a3c-43b6-beb1-a42dc2f74d95 service neutron] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:38.005977 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:38.006667 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:38.006948 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:38.007227 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] PATH_INFO: `/v3/users/4d7c50ecfb3740b5a729192be04fbd2f` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:38.008558 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7c50ecfb3740b5a729192be04fbd2f)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:38.010699 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:38.082578 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7c50ecfb3740b5a729192be04fbd2f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.095039 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7c50ecfb3740b5a729192be04fbd2f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.096239 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7c50ecfb3740b5a729192be04fbd2f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.113254 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7c50ecfb3740b5a729192be04fbd2f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.123007 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7c50ecfb3740b5a729192be04fbd2f'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.131458 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1456/2947] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:38:37 2022] DELETE /identity/v3/users/4d7c50ecfb3740b5a729192be04fbd2f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:38:38.384396 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:38.396492 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dec9c-cc8f-49a7-b728-920eb40c1ed2 service placement] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:38.472022 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:38.472580 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:38.472896 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:38.473212 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] PATH_INFO: `/v3/projects/9eb7672959d6462bafedb25f94d04b05` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:38.474413 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb7672959d6462bafedb25f94d04b05)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:38.476351 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:38.534725 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb7672959d6462bafedb25f94d04b05', 'request_id': 'req-19d0b55b-7323-4261-acc0-e90abeb990c9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.541315 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb7672959d6462bafedb25f94d04b05', 'request_id': 'req-19d0b55b-7323-4261-acc0-e90abeb990c9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.543056 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:38.551802 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb7672959d6462bafedb25f94d04b05', 'request_id': 'req-19d0b55b-7323-4261-acc0-e90abeb990c9'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.565604 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] The token cache is being invalidate because project 9eb7672959d6462bafedb25f94d04b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:38:38.566230 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.566661 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.568488 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1492/2948] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:38:38 2022] DELETE /identity/v3/projects/9eb7672959d6462bafedb25f94d04b05 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:38:38.573921 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:38.575475 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:38.589735 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538439-96e2-4c06-9f8c-2175472dde37 admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:38.623882 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:38.655547 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:38.656252 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:38.656478 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:38.656782 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] PATH_INFO: `/v3/users/2142df78b3234475b092d3ac318fc7b2` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:38.658056 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2142df78b3234475b092d3ac318fc7b2)` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:38.660006 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:38.715898 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2142df78b3234475b092d3ac318fc7b2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.726500 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2142df78b3234475b092d3ac318fc7b2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.727416 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2142df78b3234475b092d3ac318fc7b2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.742731 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2142df78b3234475b092d3ac318fc7b2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.751868 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.notifications [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2142df78b3234475b092d3ac318fc7b2'} {{(pid=81496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.758752 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1457/2949] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Sep 1 05:38:38 2022] DELETE /identity/v3/users/2142df78b3234475b092d3ac318fc7b2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:38:38.951256 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Authenticating user token {{(pid=81497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:38.953123 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.fernet_utils [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:38.970157 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b55b-7323-4261-acc0-e90abeb990c9 admin admin] Validating token access rules against request {{(pid=81497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:39.034697 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230f8b0dcb17425a90aa8f093d4d7ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21f4c2bbfcf4e0f8ddce568cdfb4031', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:39.035346 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:39.035735 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:39.035866 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] PATH_INFO: `/v3/projects/7f3ced38a8744f84baed36158fd313b3` {{(pid=81497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:39.037035 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3ced38a8744f84baed36158fd313b3)` {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:39.038956 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] RBAC: Authorization granted {{(pid=81497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:39.088760 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3ced38a8744f84baed36158fd313b3', 'request_id': 'req-1399b72c-b359-437b-8ab5-87edf1776e7b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:39.095391 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3ced38a8744f84baed36158fd313b3', 'request_id': 'req-1399b72c-b359-437b-8ab5-87edf1776e7b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:39.118928 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3ced38a8744f84baed36158fd313b3', 'request_id': 'req-1399b72c-b359-437b-8ab5-87edf1776e7b'} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:39.137040 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] The token cache is being invalidate because project 7f3ced38a8744f84baed36158fd313b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:38:39.137510 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:39.138575 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG keystone.notifications [None req-1399b72c-b359-437b-8ab5-87edf1776e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:39.141093 dv-cinder-836027-8-smb devstack@keystone.service[81497]: [pid: 81497|app: 0|req: 1493/2950] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Sep 1 05:38:38 2022] DELETE /identity/v3/projects/7f3ced38a8744f84baed36158fd313b3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:38:48.755000 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:49.131148 dv-cinder-836027-8-smb devstack@keystone.service[81497]: DEBUG dbcounter [-] [81497] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=55 {{(pid=81497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:34.525659 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Authenticating user token {{(pid=81496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:41:34.527354 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:41:34.677405 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9a20a-9478-4783-ae2a-c5870197b17b admin admin] Validating token access rules against request {{(pid=81496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:41:34.743894 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cfb84f7920d4d92b0fb290ac4ee105b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12ce0a3cfa094518917f5560f8695d0e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:41:34.744193 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] REQUEST_METHOD: `GET` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:41:34.744351 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] SCRIPT_NAME: `/identity` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:41:34.744650 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:41:34.746614 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.fernet_utils [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:41:34.759940 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:41:34.761689 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dae266-5e16-4582-bbd5-7a1730af95cd service placement] RBAC: Authorization granted {{(pid=81496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:41:34.773243 dv-cinder-836027-8-smb devstack@keystone.service[81496]: [pid: 81496|app: 0|req: 1458/2951] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Sep 1 05:41:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:41:44.768357 dv-cinder-836027-8-smb devstack@keystone.service[81496]: DEBUG dbcounter [-] [81496] Writing DB stats keystone:SELECT=80 {{(pid=81496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}